Jun 23 13:46:08 devstack cinder-volume[82579]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 13:46:08 devstack cinder-volume[82579]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:46:08 devstack cinder-volume[82579]: we strongly recommend against using it for new projects. Jun 23 13:46:08 devstack cinder-volume[82579]: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:46:08 devstack cinder-volume[82579]: framework. For more detail see Jun 23 13:46:08 devstack cinder-volume[82579]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:46:08 devstack cinder-volume[82579]: import eventlet # noqa Jun 23 13:46:11 devstack cinder-volume[82579]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:46:11 devstack cinder-volume[82579]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:46:11 devstack cinder-volume[82579]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:46:12 devstack cinder-volume[82579]: INFO dbcounter [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Registered counter for database cinder Jun 23 13:46:12 devstack cinder-volume[82579]: DEBUG oslo_db.sqlalchemy.engines [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:13 devstack cinder-volume[82579]: DEBUG dbcounter [-] [82579] Writer thread running {{(pid=82579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:46:13 devstack cinder-volume[82579]: INFO cinder.rpc [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 13:46:13 devstack cinder-volume[82579]: INFO cinder.rpc [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 13:46:13 devstack cinder-volume[82579]: DEBUG oslo_db.sqlalchemy.engines [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:13 devstack cinder-volume[82579]: INFO cinder.volume.manager [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Determined volume DB was empty at startup. Jun 23 13:46:13 devstack cinder-volume[82579]: DEBUG cinder.volume.manager [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82579) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 13:46:13 devstack cinder-volume[82579]: INFO cinder.volume.manager [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 13:46:13 devstack cinder-volume[82579]: WARNING stevedore.named [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:46:13 devstack cinder-volume[82579]: WARNING castellan.key_manager [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:46:13 devstack cinder-volume[82579]: WARNING cinder.keymgr.conf_key_mgr [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:46:13 devstack cinder-volume[82579]: DEBUG cinder.volume.drivers.lvm [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82579) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 13:46:13 devstack cinder-volume[82579]: DEBUG oslo_concurrency.processutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82579) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:13 devstack cinder-volume[82579]: DEBUG oslo_concurrency.processutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.464s {{(pid=82579) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_db.sqlalchemy.engines [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:14 devstack cinder-volume[82579]: INFO cinder.rpc [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 13:46:14 devstack cinder-volume[82579]: INFO cinder.rpc [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 13:46:14 devstack cinder-volume[82579]: WARNING stevedore.named [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:46:14 devstack cinder-volume[82579]: WARNING castellan.key_manager [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:46:14 devstack cinder-volume[82579]: INFO cinder.volume.manager [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_db.sqlalchemy.engines [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82579) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:14 devstack cinder-volume[82579]: INFO oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Starting 1 workers Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Started child 82748 {{(pid=82579) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Full set of CONF: {{(pid=82579) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] ******************************************************************************** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Configuration options gathered from: {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] ================================================================================ {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] allow_availability_zone_fallback = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] allow_compression_on_image_upload = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] allowed_direct_url_schemes = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] api_rate_limit = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] auth_strategy = keystone {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] az_cache_duration = 3600 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_availability_zone = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_host = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_stats_polling_interval = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backup_api_class = cinder.backup.api.API {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backup_name_template = backup-%s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backup_use_same_host = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backup_use_temp_snapshot = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] chap_password = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] chap_username = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_internal_tenant_project_id = 6efa04956e874fed8aaf67bb4d5697cd {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82748]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_internal_tenant_user_id = 5661ddd54b004dc6b5c353cb34b83c25 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cloned_volume_same_az = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cluster = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] compression_format = gzip {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] compute_api_class = cinder.compute.nova.API {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] config_dir = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] config_source = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] control_exchange = openstack {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] debug = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] default_availability_zone = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] default_group_type = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] default_volume_type = lvmdriver-1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] disk_geometry = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] driver_client_cert = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] driver_client_cert_key = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] driver_data_namespace = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] driver_ssl_cert_path = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] driver_ssl_cert_verify = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] driver_use_ssl = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] enable_force_upload = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] enable_new_services = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] enable_unsupported_driver = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] enforce_multipath_for_image_xfer = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] filter_function = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_api_insecure = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_api_ssl_compression = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_ca_certificates_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_catalog_info = image:glance:publicURL {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_num_retries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance_request_timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] goodness_function = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] graceful_shutdown_timeout = 5 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] group_api_class = cinder.group.api.API {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] host = devstack {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_compress_on_upload = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_conversion_address_space_limit = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_conversion_cpu_limit = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_conversion_disable = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_upload_use_cinder_backend = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_upload_use_internal_tenant = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_volume_cache_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_volume_cache_max_count = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] image_volume_cache_max_size_gb = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] init_host_max_objects_retrieval = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] instance_format = [instance: %(uuid)s] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] iscsi_target_flags = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] iscsi_write_cache = on {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] iser_helper = tgtadm {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] iser_ip_address = 192.168.122.110 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] iser_port = 3260 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_color = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_config_append = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_dir = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_options = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_rotate_interval = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_rotate_interval_type = days {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] log_rotation_type = none {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] max_age = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] max_logfile_count = 30 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] max_logfile_size_mb = 200 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] max_over_subscription_ratio = 20.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] message_reap_interval = 86400 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] message_ttl = 2592000 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] migration_create_volume_timeout_secs = 300 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] monkey_patch = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] monkey_patch_modules = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] my_ip = 192.168.122.110 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] no_snapshot_gb_quota = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] num_iser_scan_tries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] num_shell_tries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] num_volume_device_scan_tries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] nvmeof_conn_info_version = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] nvmet_ns_id = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82748]: INFO cinder.volume.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] nvmet_port_id = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_max_limit = 1000 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_volume_ext_list = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_volume_listen_port = 8776 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_volume_use_ssl = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] osapi_volume_workers = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] per_volume_size_limit = -1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] periodic_fuzzy_delay = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] periodic_interval = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] public_endpoint = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] publish_errors = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_backup_gigabytes = 1000 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_backups = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_gigabytes = 1000 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_groups = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_snapshots = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] quota_volumes = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] rate_limit_burst = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] rate_limit_except_level = CRITICAL {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] rate_limit_interval = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] reinit_driver_count = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] replication_device = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] report_discard_supported = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] report_interval = 120 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] reservation_clean_interval = 86400 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] reservation_expire = 86400 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] reserved_image_namespaces = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] reserved_percentage = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] rpc_response_timeout = 120 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] run_external_periodic_tasks = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] scst_target_driver = iscsi {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] scst_target_iqn_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_down_time = 720 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] shell_completion = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] snapshot_name_template = snapshot-%s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] snapshot_same_host = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] split_loggers = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] state_path = /opt/stack/data/cinder {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] storage_availability_zone = nova {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] storage_protocol = iSCSI {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] syslog_log_facility = LOG_USER {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] target_helper = lioadm {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] target_ip_address = 192.168.122.110 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] target_port = 3260 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] target_protocol = iscsi {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] target_secondary_ip_addresses = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] trace_flags = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] transport_url = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] until_refresh = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_chap_auth = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_default_quota_class = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_journal = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_json = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_multipath_for_image_xfer = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_stderr = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] use_syslog = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] verify_glance_signatures = enabled {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_api_class = cinder.volume.api.API {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_backend_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_clear = zero {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_clear_ionice = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_clear_size = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_copy_bps_limit = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_dd_blocksize = 1M {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_name_template = volume-%s {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_service_inithost_offload = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volume_usage_audit_period = month {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] zoning_mode = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.auth_section = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.auth_type = password {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.auth_version = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.cache = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.include_service_catalog = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.insecure = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.interface = public {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_password = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcache_username = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.region_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.service_type = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.backend = dogpile.cache.null {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.backend_argument = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.backend_expiration_time = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.config_prefix = cache.oslo {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.debug_cache_backend = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.enable_retry_client = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.enable_socket_keepalive = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.expiration_time = 600 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.hashclient_retry_attempts = 2 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_dead_retry = 300 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_pool_maxsize = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_sasl_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.password = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.proxies = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.redis_db = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.redis_server = localhost:6379 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.retry_attempts = 2 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.retry_delay = 0.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.socket_keepalive_count = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.socket_keepalive_idle = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.socket_keepalive_interval = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.socket_timeout = 1.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.tls_allowed_ciphers = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.tls_cafile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.tls_certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.tls_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.tls_keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cache.username = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] coordination.backend_url = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.asyncio_connection = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.asyncio_slave_connection = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.backend = sqlalchemy {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.connection = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.connection_debug = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.connection_parameters = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.connection_recycle_time = 3600 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.connection_trace = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.db_inc_retry_interval = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.db_max_retries = 20 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.db_max_retry_interval = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.db_retry_interval = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.max_overflow = 50 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.max_pool_size = 5 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.max_retries = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.mysql_wsrep_sync_wait = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.pool_timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.retry_interval = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.slave_connection = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.sqlite_synchronous = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.synchronous_reader = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] database.use_db_reconnect = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.connection_string = messaging:// {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.es_doc_type = notification {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.es_scroll_size = 10000 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.es_scroll_time = 2m {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.filter_error_trace = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.hmac_keys = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.sentinel_service_name = mymaster {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.socket_timeout = 0.1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.trace_requests = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler.trace_sqlalchemy = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler_jaeger.process_tags = {} {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler_jaeger.service_name_prefix = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] profiler_otlp.service_name_prefix = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.enforce_new_defaults = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: WARNING oslo_config.cfg [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.enforce_scope = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.policy_default_rule = default {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.policy_file = policy.yaml {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.group = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.helper_command = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] privsep_osbrick.user = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.group = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.helper_command = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] cinder_sys_admin.user = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.auth_section = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.auth_type = password {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.cafile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.collect_timing = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.insecure = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.send_service_user_token = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.split_loggers = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack sudo[82752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] service_user.timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.auth_section = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.auth_type = password {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.collect_timing = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.insecure = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack sudo[82752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.region_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.split_loggers = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] glance.timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.backend_availability_zone = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.chap_password = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.chap_username = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.disk_geometry = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.driver_client_cert = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.driver_client_cert_key = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.driver_data_namespace = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.driver_use_ssl = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.extra_capabilities = {} {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.filter_function = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.goodness_function = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.iscsi_target_flags = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.iscsi_write_cache = on {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.iser_helper = tgtadm {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.iser_port = 3260 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.lvm_share_target = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.lvm_type = auto {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.num_shell_tries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.replication_device = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.report_discard_supported = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.reserved_percentage = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.target_helper = tgtadm {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.target_port = 3260 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.target_protocol = iscsi {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.trace_flags = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.unique_fqdn_network = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.use_chap_auth = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_backend_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_clear = zero {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_clear_ionice = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_clear_size = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_reports.file_event_handler = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_reports.log_dir = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.backend_host = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.chap_password = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.chap_username = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.disk_geometry = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.driver_client_cert = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.extra_capabilities = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.filter_function = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.goodness_function = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.iser_helper = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.iser_ip_address = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.iser_port = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.lvm_share_target = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.lvm_type = auto {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.num_shell_tries = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.replication_device = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.report_discard_supported = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.reserved_percentage = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.scst_target_driver = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.storage_protocol = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.target_helper = lioadm {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.target_ip_address = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.target_port = 3260 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.trace_flags = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.use_chap_auth = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_clear = zero {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_clear_size = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] lvmdriver-1.volumes_dir = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_notifications.driver = [] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] key_manager.fixed_key = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.barbican_api_version = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.barbican_endpoint = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.barbican_endpoint_type = public {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.barbican_region_name = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.cafile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.collect_timing = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.insecure = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.number_of_retries = 60 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.retry_delay = 1 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.send_service_user_token = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.split_loggers = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.verify_ssl = True {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican.verify_ssl_path = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.auth_section = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.auth_type = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.cafile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.certfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.collect_timing = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.insecure = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.keyfile = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.split_loggers = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] barbican_service_user.timeout = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.approle_role_id = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.approle_secret_id = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.kv_mountpoint = secret {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.kv_path = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.kv_version = 2 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.namespace = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.root_token_id = **** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.ssl_ca_crt_file = None {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.timeout = 60.0 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.use_ssl = False {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:46:14 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] ******************************************************************************** {{(pid=82579) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 13:46:15 devstack sudo[82752]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:15 devstack sudo[82788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:15 devstack sudo[82788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:15 devstack sudo[82788]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.730s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:46:15 devstack cinder-volume[82748]: INFO cinder.brick.local_dev.lvm [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:15 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:15 devstack sudo[83035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:15 devstack sudo[83035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:16 devstack sudo[83035]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:16 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:16 devstack cinder-volume[82748]: DEBUG cinder.brick.local_dev.lvm [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82748) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 13:46:16 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:16 devstack sudo[83243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:16 devstack sudo[83243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:18 devstack sudo[83243]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.540s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:18 devstack sudo[83527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:18 devstack sudo[83527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:18 devstack sudo[83527]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.726s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:18 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:18 devstack sudo[83533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 13:46:18 devstack sudo[83533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:19 devstack sudo[83533]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:19 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.886s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:19 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:19 devstack sudo[83572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:19 devstack sudo[83572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:20 devstack sudo[83572]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:20 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.993s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:20 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:20 devstack sudo[83584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:20 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:21 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:21 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.999s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:21 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:21 devstack sudo[83590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:21 devstack sudo[83590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:22 devstack sudo[83590]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:22 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.798s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:22 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:22 devstack sudo[83600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:22 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:23 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:23 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:23 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:23 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:23 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:23 devstack sudo[83604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:23 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:24 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.896s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:24 devstack cinder-volume[82748]: INFO cinder.volume.drivers.lvm [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:24 devstack cinder-volume[82579]: DEBUG dbcounter [-] [82579] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82579) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:46:24 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:24 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:24 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.742s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:46:24 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:24 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:24 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:25 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:25 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:25 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:25 devstack sudo[83872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:25 devstack sudo[83872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:26 devstack sudo[83872]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:26 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:26 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:26 devstack sudo[83875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:26 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:26 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:26 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:26 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:27 devstack sudo[83878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:27 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:27 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.785s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:27 devstack cinder-volume[82748]: INFO cinder.volume.driver [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Driver hasn't implemented _init_vendor_properties() Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG cinder.volume.driver [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82748) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG oslo_db.sqlalchemy.engines [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82748) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG dbcounter [-] [82748] Writer thread running {{(pid=82748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG cinder.db.api [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Building query based on filter {{(pid=82748) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG cinder.image.image_utils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82748) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 13:46:27 devstack cinder-volume[82748]: INFO cinder.keymgr.migration [None req-3e25797a-ad8c-4164-ba2f-f1d77a974aa6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:46:27 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:27 devstack sudo[83886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:27 devstack sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:28 devstack sudo[83886]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:28 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:28 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:28 devstack sudo[83889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:28 devstack sudo[83889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:29 devstack sudo[83889]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:29 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:29 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:29 devstack sudo[83892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:29 devstack sudo[83892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:30 devstack sudo[83892]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:30 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.697s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:30 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:30 devstack sudo[83896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:30 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:30 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:30 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:30 devstack cinder-volume[82748]: DEBUG cinder.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Notifying Schedulers of capabilities ... {{(pid=82748) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:46:30 devstack cinder-volume[82748]: INFO cinder.volume.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Driver initialization completed successfully. Jun 23 13:46:30 devstack cinder-volume[82748]: INFO cinder.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Initiating service 2 cleanup Jun 23 13:46:30 devstack cinder-volume[82748]: INFO cinder.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Service 2 cleanup completed. Jun 23 13:46:30 devstack cinder-volume[82748]: DEBUG cinder.service [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Creating RPC server for service cinder-volume {{(pid=82748) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 13:46:30 devstack cinder-volume[82748]: DEBUG cinder.service [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82748) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 13:46:31 devstack cinder-volume[82748]: INFO cinder.volume.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 13:46:31 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:46:31 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:31 devstack sudo[83900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:46:31 devstack sudo[83900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:31 devstack sudo[83900]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:31 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.824s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:31 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:31 devstack sudo[83907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:31 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:32 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:32 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:32 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:32 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:46:32 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:33 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:33 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.713s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:33 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:46:33 devstack sudo[83967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:46:33 devstack sudo[83967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:46:34 devstack sudo[83967]: pam_unix(sudo:session): session closed for user root Jun 23 13:46:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:46:34 devstack cinder-volume[82748]: INFO cinder.volume.manager [None req-65ea2b2a-14cf-4925-b246-7c1eefd87e0a None None] Driver post RPC initialization completed successfully. Jun 23 13:46:44 devstack cinder-volume[82748]: DEBUG dbcounter [-] [82748] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:46:44 devstack cinder-volume[82748]: DEBUG dbcounter [-] [82748] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:47:34 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:47:34 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:47:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:34 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:47:34 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:34 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:34 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:34 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:35 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:35 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:47:35 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:36 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:47:36 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:47:36 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:47:36 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG cinder.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Notifying Schedulers of capabilities ... {{(pid=82748) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager._thread_info {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG cinder.volume.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] thread count: 6 {{(pid=82748) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:47:36 devstack cinder-volume[82748]: DEBUG cinder.volume.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] thread info: [<_MainThread(MainThread, started 126475283918976)>, , , , , ] {{(pid=82748) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:48:34 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:48:34 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:48:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:34 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:48:34 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:34 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:34 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:48:34 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:35 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:35 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:48:35 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:36 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:48:36 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:48:36 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:48:36 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Jun 23 13:48:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:48:36 devstack cinder-volume[82748]: DEBUG cinder.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Notifying Schedulers of capabilities ... {{(pid=82748) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:48:44 devstack cinder-volume[82748]: DEBUG dbcounter [-] [82748] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:49:34 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:49:34 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:49:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:34 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:49:34 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:34 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:34 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:49:34 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:35 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:35 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:49:35 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:36 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.718s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:49:36 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:49:36 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:49:36 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG cinder.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Notifying Schedulers of capabilities ... {{(pid=82748) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager._thread_info {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG cinder.volume.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] thread count: 6 {{(pid=82748) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:49:36 devstack cinder-volume[82748]: DEBUG cinder.volume.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] thread info: [<_MainThread(MainThread, started 126475283918976)>, , , , , ] {{(pid=82748) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:50:34 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:50:34 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:50:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:34 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:50:34 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:34 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:34 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:50:34 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:35 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:35 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:50:35 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:36 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:50:36 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:50:36 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:50:36 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Jun 23 13:50:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:50:36 devstack cinder-volume[82748]: DEBUG cinder.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Notifying Schedulers of capabilities ... {{(pid=82748) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:50:44 devstack cinder-volume[82748]: DEBUG dbcounter [-] [82748] Writing DB stats cinder:SELECT=1 {{(pid=82748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:50:44 devstack cinder-volume[82748]: DEBUG dbcounter [-] [82748] Writing DB stats cinder:UPDATE=1 {{(pid=82748) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:51:34 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:51:34 devstack cinder-volume[82748]: DEBUG cinder.volume.drivers.lvm [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Updating volume stats {{(pid=82748) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 13:51:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:34 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 13:51:34 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:34 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:34 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:34 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:51:34 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:35 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:35 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:35 devstack sudo[92677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 13:51:35 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:36 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:36 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 13:51:36 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:36 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG oslo_concurrency.processutils [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=82748) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG cinder.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Notifying Schedulers of capabilities ... {{(pid=82748) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG oslo_service.periodic_task [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] Running periodic task VolumeManager._thread_info {{(pid=82748) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG cinder.volume.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] thread count: 6 {{(pid=82748) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:51:36 devstack cinder-volume[82748]: DEBUG cinder.volume.manager [None req-95c24641-c894-424a-a287-8a10cf10fde7 None None] thread info: [<_MainThread(MainThread, started 126475283918976)>, , , , , ] {{(pid=82748) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:51:40 devstack cinder-volume[82579]: INFO oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Caught SIGTERM, stopping children Jun 23 13:51:40 devstack cinder-volume[82579]: DEBUG oslo_concurrency.lockutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Acquiring lock "singleton_lock" {{(pid=82579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:51:40 devstack cinder-volume[82579]: DEBUG oslo_concurrency.lockutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Acquired lock "singleton_lock" {{(pid=82579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:51:40 devstack cinder-volume[82579]: DEBUG oslo_concurrency.lockutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Releasing lock "singleton_lock" {{(pid=82579) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:51:40 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Stop services. {{(pid=82579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 13:51:40 devstack cinder-volume[82579]: DEBUG oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Killing children. {{(pid=82579) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 13:51:40 devstack cinder-volume[82579]: INFO oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Waiting on 1 children to exit Jun 23 13:51:41 devstack cinder-volume[82748]: DEBUG oslo_concurrency.lockutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Acquiring lock "singleton_lock" {{(pid=82748) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:51:41 devstack cinder-volume[82748]: DEBUG oslo_concurrency.lockutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Acquired lock "singleton_lock" {{(pid=82748) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:51:41 devstack cinder-volume[82748]: DEBUG oslo_concurrency.lockutils [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Releasing lock "singleton_lock" {{(pid=82748) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:51:41 devstack cinder-volume[82748]: WARNING amqp [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:51:41 devstack cinder-volume[82748]: WARNING amqp [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:51:41 devstack cinder-volume[82579]: INFO oslo_service.backend._eventlet.service [None req-402de004-53ba-41b0-b94c-b6b356cc69a1 None None] Child 82748 exited with status 0 Jun 23 13:51:41 devstack cinder-volume[92895]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 13:51:41 devstack cinder-volume[92895]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:51:41 devstack cinder-volume[92895]: we strongly recommend against using it for new projects. Jun 23 13:51:41 devstack cinder-volume[92895]: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:51:41 devstack cinder-volume[92895]: framework. For more detail see Jun 23 13:51:41 devstack cinder-volume[92895]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:51:41 devstack cinder-volume[92895]: import eventlet # noqa Jun 23 13:51:43 devstack cinder-volume[92895]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:51:43 devstack cinder-volume[92895]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:51:43 devstack cinder-volume[92895]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:51:44 devstack cinder-volume[92895]: INFO dbcounter [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Registered counter for database cinder Jun 23 13:51:44 devstack cinder-volume[92895]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:51:44 devstack cinder-volume[92895]: DEBUG dbcounter [-] [92895] Writer thread running {{(pid=92895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:51:44 devstack cinder-volume[92895]: INFO cinder.rpc [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 13:51:44 devstack cinder-volume[92895]: INFO cinder.rpc [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 13:51:44 devstack cinder-volume[92895]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:51:45 devstack cinder-volume[92895]: INFO cinder.volume.manager [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Determined volume DB was empty at startup. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG cinder.volume.manager [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92895) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 13:51:45 devstack cinder-volume[92895]: INFO cinder.volume.manager [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 13:51:45 devstack cinder-volume[92895]: WARNING stevedore.named [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:51:45 devstack cinder-volume[92895]: WARNING castellan.key_manager [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:51:45 devstack cinder-volume[92895]: WARNING cinder.keymgr.conf_key_mgr [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:51:45 devstack cinder-volume[92895]: INFO cinder.volume.manager [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_db.sqlalchemy.engines [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92895) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:51:45 devstack cinder-volume[92895]: INFO oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Starting 1 workers Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Started child 93108 {{(pid=92895) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Full set of CONF: {{(pid=92895) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] ******************************************************************************** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Configuration options gathered from: {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] ================================================================================ {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] allow_availability_zone_fallback = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] allow_compression_on_image_upload = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] allowed_direct_url_schemes = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] api_rate_limit = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] auth_strategy = keystone {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_availability_zone = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_host = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_stats_polling_interval = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backup_api_class = cinder.backup.api.API {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backup_name_template = backup-%s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backup_use_same_host = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backup_use_temp_snapshot = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] chap_password = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] chap_username = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_internal_tenant_project_id = 6efa04956e874fed8aaf67bb4d5697cd {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_internal_tenant_user_id = 5661ddd54b004dc6b5c353cb34b83c25 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cluster = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] compression_format = gzip {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] compute_api_class = cinder.compute.nova.API {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] config_dir = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] config_source = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] control_exchange = openstack {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] debug = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] default_availability_zone = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] default_group_type = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] default_volume_type = QuobyteHD {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] disk_geometry = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] driver_client_cert = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] driver_client_cert_key = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] driver_data_namespace = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] driver_ssl_cert_path = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] driver_ssl_cert_verify = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] driver_use_ssl = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] enable_new_services = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] enable_unsupported_driver = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] enabled_backends = ['QuobyteHD'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: INFO cinder.volume.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] enforce_multipath_for_image_xfer = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.remotefs [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93108) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] filter_function = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_api_insecure = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_api_ssl_compression = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_ca_certificates_file = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_catalog_info = image:glance:publicURL {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_num_retries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance_request_timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] goodness_function = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] graceful_shutdown_timeout = 5 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] group_api_class = cinder.group.api.API {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] host = devstack {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_compress_on_upload = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_conversion_address_space_limit = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_conversion_cpu_limit = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_conversion_disable = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_upload_use_cinder_backend = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_upload_use_internal_tenant = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_volume_cache_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_volume_cache_max_count = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] image_volume_cache_max_size_gb = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] init_host_max_objects_retrieval = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] instance_format = [instance: %(uuid)s] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] iscsi_target_flags = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] iscsi_write_cache = on {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] iser_helper = tgtadm {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] iser_ip_address = 192.168.122.110 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] iser_port = 3260 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_color = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_config_append = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_dir = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_file = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_options = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_rotate_interval = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_rotate_interval_type = days {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] log_rotation_type = none {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] max_age = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] max_logfile_count = 30 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] max_logfile_size_mb = 200 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] max_over_subscription_ratio = 20.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] message_reap_interval = 86400 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] message_ttl = 2592000 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] migration_create_volume_timeout_secs = 300 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] monkey_patch = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] monkey_patch_modules = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] my_ip = 192.168.122.110 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] no_snapshot_gb_quota = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] num_iser_scan_tries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] num_shell_tries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] num_volume_device_scan_tries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] nvmeof_conn_info_version = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] nvmet_ns_id = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] nvmet_port_id = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_max_limit = 1000 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_volume_ext_list = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_volume_listen_port = 8776 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93108) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_volume_use_ssl = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: WARNING cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] osapi_volume_workers = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] per_volume_size_limit = -1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] periodic_fuzzy_delay = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: WARNING cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] periodic_interval = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] public_endpoint = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] publish_errors = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_backup_gigabytes = 1000 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_backups = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Running cmd (subprocess): mount.quobyte {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_gigabytes = 1000 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_groups = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_snapshots = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] quota_volumes = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] rate_limit_burst = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] rate_limit_except_level = CRITICAL {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] rate_limit_interval = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] reinit_driver_count = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] replication_device = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] report_discard_supported = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] report_interval = 120 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] reservation_clean_interval = 86400 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] reservation_expire = 86400 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] reserved_image_namespaces = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] reserved_percentage = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] rpc_response_timeout = 120 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] run_external_periodic_tasks = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] scst_target_driver = iscsi {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] scst_target_iqn_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_down_time = 720 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] shell_completion = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] snapshot_name_template = snapshot-%s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] split_loggers = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] state_path = /opt/stack/data/cinder {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] storage_availability_zone = nova {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] storage_protocol = iSCSI {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] syslog_log_facility = LOG_USER {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] target_helper = lioadm {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] target_ip_address = 192.168.122.110 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] target_port = 3260 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] target_protocol = iscsi {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] target_secondary_ip_addresses = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] trace_flags = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] transport_url = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] until_refresh = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_chap_auth = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_default_quota_class = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_journal = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_json = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_multipath_for_image_xfer = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_stderr = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] use_syslog = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] verify_glance_signatures = enabled {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_api_class = cinder.volume.api.API {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_backend_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_clear = zero {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_clear_ionice = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_clear_size = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_copy_bps_limit = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_dd_blocksize = 1M {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_name_template = volume-%s {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_service_inithost_offload = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volume_usage_audit_period = month {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] zoning_mode = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_concurrency.disable_process_locking = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.auth_section = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.auth_type = password {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.auth_version = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.cache = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.include_service_catalog = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.insecure = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.interface = public {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_password = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcache_username = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.region_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.service_type = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.backend = dogpile.cache.null {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.backend_argument = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.backend_expiration_time = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.config_prefix = cache.oslo {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.debug_cache_backend = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.enable_retry_client = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.enable_socket_keepalive = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.expiration_time = 600 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.hashclient_retry_attempts = 2 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_dead_retry = 300 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_pool_maxsize = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_sasl_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.password = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.proxies = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.redis_db = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.redis_server = localhost:6379 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.retry_attempts = 2 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.retry_delay = 0.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.socket_keepalive_count = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.socket_keepalive_idle = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.socket_keepalive_interval = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.socket_timeout = 1.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.tls_allowed_ciphers = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.tls_cafile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.tls_certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.tls_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.tls_keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cache.username = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] coordination.backend_url = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.asyncio_connection = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.asyncio_slave_connection = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.backend = sqlalchemy {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.connection = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.connection_debug = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.connection_parameters = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.connection_recycle_time = 3600 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.connection_trace = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.db_inc_retry_interval = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.db_max_retries = 20 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.db_max_retry_interval = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.db_retry_interval = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.max_overflow = 50 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.max_pool_size = 5 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.max_retries = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.mysql_wsrep_sync_wait = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.pool_timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.retry_interval = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.slave_connection = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.sqlite_synchronous = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.synchronous_reader = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] database.use_db_reconnect = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.connection_string = messaging:// {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.es_doc_type = notification {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.es_scroll_size = 10000 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.es_scroll_time = 2m {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.filter_error_trace = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.hmac_keys = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.sentinel_service_name = mymaster {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.socket_timeout = 0.1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.trace_requests = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler.trace_sqlalchemy = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler_jaeger.process_tags = {} {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler_jaeger.service_name_prefix = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] profiler_otlp.service_name_prefix = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.enforce_new_defaults = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: WARNING oslo_config.cfg [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.enforce_scope = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.policy_default_rule = default {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.policy_file = policy.yaml {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.group = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.helper_command = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] privsep_osbrick.user = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.group = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.helper_command = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] cinder_sys_admin.user = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.auth_section = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.auth_type = password {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.cafile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.collect_timing = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.insecure = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.send_service_user_token = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.split_loggers = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] service_user.timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.auth_section = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.auth_type = password {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.collect_timing = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.insecure = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.region_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.split_loggers = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] glance.timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.backend_availability_zone = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.chap_password = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.chap_username = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.disk_geometry = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.driver_client_cert = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.driver_client_cert_key = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.driver_data_namespace = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.driver_use_ssl = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.extra_capabilities = {} {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.filter_function = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.goodness_function = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.iscsi_target_flags = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.iscsi_write_cache = on {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.iser_helper = tgtadm {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.iser_port = 3260 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_host = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_login = admin {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_mount_options = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_password = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_private_key = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_share_path = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.num_shell_tries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.quobyte_volume_url = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.replication_device = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.report_discard_supported = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.reserved_percentage = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.target_helper = tgtadm {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.target_port = 3260 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.target_protocol = iscsi {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.trace_flags = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.unique_fqdn_network = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.use_chap_auth = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_backend_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_clear = zero {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_clear_ionice = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_clear_size = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_reports.file_event_handler = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_reports.log_dir = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.backend_availability_zone = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.backend_host = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.chap_password = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.chap_username = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.chiscsi_conf = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.disk_geometry = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.driver_client_cert = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.driver_data_namespace = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.driver_use_ssl = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.extra_capabilities = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.filter_function = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.goodness_function = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.iser_helper = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.iser_ip_address = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.iser_port = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.iser_target_prefix = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_host = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_login = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_mount_options = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_password = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_private_key = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_share_path = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_ssh_port = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.num_shell_tries = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.nvmet_port_id = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.replication_device = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.report_discard_supported = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.reserved_percentage = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.scst_target_driver = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.storage_protocol = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.target_helper = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.target_ip_address = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.target_port = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.target_prefix = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.target_protocol = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.trace_flags = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.use_chap_auth = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_clear = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_clear_size = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] QuobyteHD.volumes_dir = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack quobyte-client[93113]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack quobyte-client[93113]: Invalid parameters found, error: missing mount point. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack quobyte-client[93113]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack quobyte-client[93113]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] CMD "mount.quobyte" returned: 1 in 0.164s {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_notifications.driver = [] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_notifications.retry = -1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] key_manager.fixed_key = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.barbican_api_version = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.barbican_endpoint = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.barbican_endpoint_type = public {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.barbican_region_name = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.cafile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.collect_timing = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.insecure = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.number_of_retries = 60 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.retry_delay = 1 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.send_service_user_token = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.split_loggers = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.verify_ssl = True {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[93108]: INFO cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 ... Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican.verify_ssl_path = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.auth_section = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec -c /etc/quobyte/client-cinder.cfg {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.auth_type = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.cafile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.certfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.collect_timing = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.insecure = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.keyfile = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.split_loggers = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] barbican_service_user.timeout = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.approle_role_id = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.approle_secret_id = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.kv_mountpoint = secret {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.kv_path = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.kv_version = 2 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.namespace = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.root_token_id = **** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.ssl_ca_crt_file = None {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.timeout = 60.0 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.use_ssl = False {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:51:45 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] ******************************************************************************** {{(pid=92895) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 13:51:45 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec -c /etc/quobyte/client-cinder.cfg Jun 23 13:51:45 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:46 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:46 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.842s {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:46 devstack cinder-volume[93108]: INFO cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 succeeded Jun 23 13:51:46 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:51:46 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.862s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:51:46 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:46 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:51:46 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:47 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.714s {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:47 devstack cinder-volume[93108]: INFO cinder.volume.driver [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG cinder.volume.driver [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93108) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_db.sqlalchemy.engines [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93108) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG dbcounter [-] [93108] Writer thread running {{(pid=93108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG cinder.db.api [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Building query based on filter {{(pid=93108) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG cinder.image.image_utils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93108) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 13:51:47 devstack cinder-volume[93108]: INFO cinder.keymgr.migration [None req-44e688d3-4c03-453c-9c1c-80bf778c1415 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:47 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:51:47 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:47 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.674s {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:47 devstack cinder-volume[93108]: DEBUG cinder.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Notifying Schedulers of capabilities ... {{(pid=93108) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:51:48 devstack cinder-volume[93108]: INFO cinder.volume.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Driver initialization completed successfully. Jun 23 13:51:48 devstack cinder-volume[93108]: INFO cinder.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Initiating service 3 cleanup Jun 23 13:51:48 devstack cinder-volume[93108]: INFO cinder.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Service 3 cleanup completed. Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG cinder.service [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Creating RPC server for service cinder-volume {{(pid=93108) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG cinder.service [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93108) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 13:51:48 devstack cinder-volume[93108]: INFO cinder.volume.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:51:48 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:48 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:51:48 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:49 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:49 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.873s {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:49 devstack cinder-volume[93108]: INFO cinder.volume.manager [None req-2b185a1d-0775-4959-abb5-f88d4e8f1542 None None] Driver post RPC initialization completed successfully. Jun 23 13:51:53 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:51:53 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:51:53 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93108) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:51:53 devstack cinder-volume[93108]: DEBUG cinder.volume.drivers.quobyte [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93108) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:51:53 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93108) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:51:53 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:51:53 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:51:53 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:51:54 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jun 23 13:51:54 devstack cinder-volume[93108]: DEBUG oslo_concurrency.processutils [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.683s {{(pid=93108) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:51:54 devstack cinder-volume[93108]: DEBUG cinder.manager [None req-1c6e2297-c232-4813-b0a0-c5366524fac5 None None] Notifying Schedulers of capabilities ... {{(pid=93108) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:51:55 devstack cinder-volume[92895]: DEBUG dbcounter [-] [92895] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92895) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:51:56 devstack cinder-volume[93108]: DEBUG oslo_service.periodic_task [None req-148490b0-ae2a-4feb-9273-36f5febdc1ed None None] Running periodic task VolumeManager._thread_info {{(pid=93108) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:51:56 devstack cinder-volume[93108]: DEBUG cinder.volume.manager [None req-148490b0-ae2a-4feb-9273-36f5febdc1ed None None] thread count: 6 {{(pid=93108) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:51:56 devstack cinder-volume[93108]: DEBUG cinder.volume.manager [None req-148490b0-ae2a-4feb-9273-36f5febdc1ed None None] thread info: [<_MainThread(MainThread, started 123607656714368)>, , , , , ] {{(pid=93108) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:51:56 devstack cinder-volume[92895]: INFO oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Caught SIGTERM, stopping children Jun 23 13:51:56 devstack cinder-volume[92895]: DEBUG oslo_concurrency.lockutils [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Acquiring lock "singleton_lock" {{(pid=92895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:51:56 devstack cinder-volume[92895]: DEBUG oslo_concurrency.lockutils [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Acquired lock "singleton_lock" {{(pid=92895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:51:56 devstack cinder-volume[92895]: DEBUG oslo_concurrency.lockutils [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Releasing lock "singleton_lock" {{(pid=92895) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:51:56 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Stop services. {{(pid=92895) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 13:51:56 devstack cinder-volume[92895]: DEBUG oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Killing children. {{(pid=92895) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 13:51:56 devstack cinder-volume[92895]: INFO oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Waiting on 1 children to exit Jun 23 13:51:58 devstack cinder-volume[93108]: DEBUG dbcounter [-] [93108] Writing DB stats cinder:SELECT=2 {{(pid=93108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:51:59 devstack cinder-volume[93108]: DEBUG dbcounter [-] [93108] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93108) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:52:01 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Acquiring lock "singleton_lock" {{(pid=93108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:01 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Acquired lock "singleton_lock" {{(pid=93108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:01 devstack cinder-volume[93108]: DEBUG oslo_concurrency.lockutils [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Releasing lock "singleton_lock" {{(pid=93108) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:01 devstack cinder-volume[93108]: WARNING amqp [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:52:01 devstack cinder-volume[93108]: WARNING amqp [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 13:52:01 devstack cinder-volume[92895]: INFO oslo_service.backend._eventlet.service [None req-e8d80858-139f-45c2-b90e-057c90dd3b68 None None] Child 93108 exited with status 0 Jun 23 13:52:02 devstack cinder-volume[93408]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 13:52:02 devstack cinder-volume[93408]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:52:02 devstack cinder-volume[93408]: we strongly recommend against using it for new projects. Jun 23 13:52:02 devstack cinder-volume[93408]: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:52:02 devstack cinder-volume[93408]: framework. For more detail see Jun 23 13:52:02 devstack cinder-volume[93408]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:52:02 devstack cinder-volume[93408]: import eventlet # noqa Jun 23 13:52:04 devstack cinder-volume[93408]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93408) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 13:52:04 devstack cinder-volume[93408]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93408) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 13:52:04 devstack cinder-volume[93408]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93408) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 13:52:05 devstack cinder-volume[93408]: INFO dbcounter [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Registered counter for database cinder Jun 23 13:52:05 devstack cinder-volume[93408]: DEBUG oslo_db.sqlalchemy.engines [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93408) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:05 devstack cinder-volume[93408]: DEBUG dbcounter [-] [93408] Writer thread running {{(pid=93408) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:52:05 devstack cinder-volume[93408]: INFO cinder.rpc [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 13:52:05 devstack cinder-volume[93408]: INFO cinder.rpc [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 13:52:05 devstack cinder-volume[93408]: DEBUG oslo_db.sqlalchemy.engines [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93408) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:06 devstack cinder-volume[93408]: INFO cinder.volume.manager [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Determined volume DB was empty at startup. Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG cinder.volume.manager [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93408) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 13:52:06 devstack cinder-volume[93408]: WARNING stevedore.named [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 13:52:06 devstack cinder-volume[93408]: WARNING castellan.key_manager [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:52:06 devstack cinder-volume[93408]: WARNING cinder.keymgr.conf_key_mgr [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 13:52:06 devstack cinder-volume[93408]: INFO cinder.volume.manager [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_db.sqlalchemy.engines [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93408) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:06 devstack cinder-volume[93408]: INFO oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Starting 1 workers Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Started child 93605 {{(pid=93408) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Full set of CONF: {{(pid=93408) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] ******************************************************************************** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Configuration options gathered from: {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] ================================================================================ {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] allow_availability_zone_fallback = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] allow_compression_on_image_upload = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] allowed_direct_url_schemes = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] api_rate_limit = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93605]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] auth_strategy = keystone {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_availability_zone = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_host = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_stats_polling_interval = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backup_api_class = cinder.backup.api.API {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backup_name_template = backup-%s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backup_use_same_host = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backup_use_temp_snapshot = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] chap_password = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] chap_username = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_internal_tenant_project_id = 6efa04956e874fed8aaf67bb4d5697cd {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_internal_tenant_user_id = 5661ddd54b004dc6b5c353cb34b83c25 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cluster = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] compression_format = gzip {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] compute_api_class = cinder.compute.nova.API {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] config_dir = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] config_source = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] control_exchange = openstack {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] debug = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] default_availability_zone = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] default_group_type = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] default_volume_type = QuobyteHD {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] disk_geometry = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] driver_client_cert = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] driver_client_cert_key = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] driver_data_namespace = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] driver_ssl_cert_path = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] driver_ssl_cert_verify = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] driver_use_ssl = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] enable_new_services = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] enable_unsupported_driver = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] enabled_backends = ['QuobyteHD'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] enforce_multipath_for_image_xfer = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] filter_function = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_api_insecure = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_api_ssl_compression = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_ca_certificates_file = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_catalog_info = image:glance:publicURL {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_num_retries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance_request_timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] goodness_function = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] graceful_shutdown_timeout = 5 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] group_api_class = cinder.group.api.API {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] host = devstack {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_compress_on_upload = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_conversion_address_space_limit = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_conversion_cpu_limit = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_conversion_disable = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_upload_use_cinder_backend = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_upload_use_internal_tenant = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_volume_cache_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_volume_cache_max_count = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] image_volume_cache_max_size_gb = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] init_host_max_objects_retrieval = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] instance_format = [instance: %(uuid)s] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] iscsi_target_flags = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] iscsi_write_cache = on {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] iser_helper = tgtadm {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] iser_ip_address = 192.168.122.110 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] iser_port = 3260 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_color = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_config_append = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_dir = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_file = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_options = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_rotate_interval = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_rotate_interval_type = days {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] log_rotation_type = none {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] max_age = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] max_logfile_count = 30 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] max_logfile_size_mb = 200 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] max_over_subscription_ratio = 20.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] message_reap_interval = 86400 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] message_ttl = 2592000 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] migration_create_volume_timeout_secs = 300 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] monkey_patch = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] monkey_patch_modules = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] my_ip = 192.168.122.110 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] no_snapshot_gb_quota = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] num_iser_scan_tries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] num_shell_tries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] num_volume_device_scan_tries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] nvmeof_conn_info_version = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] nvmet_ns_id = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] nvmet_port_id = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_max_limit = 1000 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_volume_ext_list = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_volume_listen_port = 8776 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_volume_use_ssl = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] osapi_volume_workers = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] per_volume_size_limit = -1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] periodic_fuzzy_delay = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] periodic_interval = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] public_endpoint = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] publish_errors = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_backup_gigabytes = 1000 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_backups = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_gigabytes = 1000 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93605) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_groups = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_snapshots = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] quota_volumes = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] rate_limit_burst = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] rate_limit_except_level = CRITICAL {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] rate_limit_interval = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] reinit_driver_count = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] replication_device = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] report_discard_supported = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] report_interval = 120 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] reservation_clean_interval = 86400 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] reservation_expire = 86400 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] reserved_image_namespaces = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] reserved_percentage = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] rpc_response_timeout = 120 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] run_external_periodic_tasks = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] scst_target_driver = iscsi {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] scst_target_iqn_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_down_time = 720 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] shell_completion = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] snapshot_name_template = snapshot-%s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] split_loggers = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] state_path = /opt/stack/data/cinder {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] storage_availability_zone = nova {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] storage_protocol = iSCSI {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] syslog_log_facility = LOG_USER {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] target_helper = lioadm {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] target_ip_address = 192.168.122.110 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] target_port = 3260 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] target_protocol = iscsi {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] target_secondary_ip_addresses = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] trace_flags = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] transport_url = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] until_refresh = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_chap_auth = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_default_quota_class = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_journal = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_json = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_multipath_for_image_xfer = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_stderr = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] use_syslog = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] verify_glance_signatures = enabled {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_api_class = cinder.volume.api.API {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_backend_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_clear = zero {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_clear_ionice = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_clear_size = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_copy_bps_limit = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_dd_blocksize = 1M {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_name_template = volume-%s {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_service_inithost_offload = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volume_usage_audit_period = month {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] zoning_mode = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_concurrency.disable_process_locking = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.auth_section = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.auth_type = password {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.auth_version = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.cache = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.include_service_catalog = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.insecure = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.interface = public {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_password = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcache_username = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.region_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.service_type = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.backend = dogpile.cache.null {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.backend_argument = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.backend_expiration_time = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.config_prefix = cache.oslo {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.debug_cache_backend = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.enable_retry_client = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.enable_socket_keepalive = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.expiration_time = 600 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.hashclient_retry_attempts = 2 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_dead_retry = 300 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_pool_maxsize = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_sasl_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.password = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.proxies = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.redis_db = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.redis_server = localhost:6379 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.retry_attempts = 2 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.retry_delay = 0.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.socket_keepalive_count = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.socket_keepalive_idle = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.socket_keepalive_interval = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.socket_timeout = 1.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.tls_allowed_ciphers = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.tls_cafile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.tls_certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.tls_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.tls_keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cache.username = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] coordination.backend_url = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.asyncio_connection = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.asyncio_slave_connection = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.backend = sqlalchemy {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.connection = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.connection_debug = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.connection_parameters = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93605) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 13:52:06 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 13:52:06 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.connection_recycle_time = 3600 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.connection_trace = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.db_inc_retry_interval = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.db_max_retries = 20 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.db_max_retry_interval = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.db_retry_interval = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.max_overflow = 50 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Running cmd (subprocess): mount.quobyte {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.max_pool_size = 5 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.max_retries = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.mysql_wsrep_sync_wait = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.pool_timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.retry_interval = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.slave_connection = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.sqlite_synchronous = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.synchronous_reader = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] database.use_db_reconnect = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.connection_string = messaging:// {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.es_doc_type = notification {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.es_scroll_size = 10000 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.es_scroll_time = 2m {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.filter_error_trace = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.hmac_keys = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.sentinel_service_name = mymaster {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.socket_timeout = 0.1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.trace_requests = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler.trace_sqlalchemy = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler_jaeger.process_tags = {} {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler_jaeger.service_name_prefix = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] profiler_otlp.service_name_prefix = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.enforce_new_defaults = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: WARNING oslo_config.cfg [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.enforce_scope = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.policy_default_rule = default {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.policy_file = policy.yaml {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.group = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.helper_command = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] privsep_osbrick.user = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.group = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.helper_command = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] cinder_sys_admin.user = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.auth_section = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.auth_type = password {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.cafile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.collect_timing = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.insecure = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.send_service_user_token = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.split_loggers = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] service_user.timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.auth_section = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.auth_type = password {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.collect_timing = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.insecure = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.region_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.split_loggers = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] glance.timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.backend_availability_zone = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.chap_password = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.chap_username = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.disk_geometry = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.driver_client_cert = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.driver_client_cert_key = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.driver_data_namespace = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.driver_use_ssl = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.extra_capabilities = {} {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.filter_function = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.goodness_function = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.iscsi_target_flags = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.iscsi_write_cache = on {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.iser_helper = tgtadm {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.iser_port = 3260 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_host = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_login = admin {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_mount_options = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_password = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_private_key = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_share_path = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.num_shell_tries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.quobyte_volume_url = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.replication_device = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.report_discard_supported = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.reserved_percentage = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.target_helper = tgtadm {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.target_port = 3260 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.target_protocol = iscsi {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.trace_flags = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.unique_fqdn_network = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.use_chap_auth = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_backend_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_clear = zero {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_clear_ionice = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_clear_size = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_reports.file_event_handler = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_reports.log_dir = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.backend_availability_zone = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.backend_host = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.chap_password = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.chap_username = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.chiscsi_conf = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.disk_geometry = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.driver_client_cert = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.driver_data_namespace = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.driver_use_ssl = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.extra_capabilities = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.filter_function = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.goodness_function = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack quobyte-client[93632]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 13:52:06 devstack quobyte-client[93632]: Invalid parameters found, error: missing mount point. Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack quobyte-client[93632]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.iser_helper = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.iser_ip_address = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack quobyte-client[93632]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.iser_port = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.iser_target_prefix = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_host = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_login = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_mount_options = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_password = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_private_key = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_share_path = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_ssh_port = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.num_shell_tries = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.nvmet_port_id = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.replication_device = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.report_discard_supported = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.reserved_percentage = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.scst_target_driver = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.storage_protocol = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.target_helper = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.target_ip_address = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.target_port = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.target_prefix = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.target_protocol = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.trace_flags = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.use_chap_auth = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_clear = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_clear_size = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] QuobyteHD.volumes_dir = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_notifications.driver = [] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_notifications.retry = -1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] key_manager.fixed_key = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.barbican_api_version = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.barbican_endpoint = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.barbican_endpoint_type = public {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.barbican_region_name = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.cafile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.collect_timing = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.insecure = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.number_of_retries = 60 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.retry_delay = 1 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.send_service_user_token = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.split_loggers = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.verify_ssl = True {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican.verify_ssl_path = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.auth_section = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.auth_type = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.cafile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.certfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.collect_timing = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.insecure = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.keyfile = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.split_loggers = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] barbican_service_user.timeout = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.approle_role_id = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.approle_secret_id = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.kv_mountpoint = secret {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.kv_path = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.kv_version = 2 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.namespace = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.root_token_id = **** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.ssl_ca_crt_file = None {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.timeout = 60.0 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.use_ssl = False {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 13:52:06 devstack cinder-volume[93408]: DEBUG oslo_service.backend._eventlet.service [None req-e479a7cf-7937-4ca6-bb1c-9d8f64d90df7 None None] ******************************************************************************** {{(pid=93408) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 13:52:07 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.655s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:07 devstack cinder-volume[93605]: INFO cinder.volume.driver [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.volume.driver [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93605) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_db.sqlalchemy.engines [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93605) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writer thread running {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.db.api [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Building query based on filter {{(pid=93605) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93605) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:07 devstack cinder-volume[93605]: INFO cinder.keymgr.migration [None req-5ba80e21-890b-41a4-b75a-f080948cea81 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 13:52:07 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:52:07 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:07 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.651s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:52:07 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Driver initialization completed successfully. Jun 23 13:52:07 devstack cinder-volume[93605]: INFO cinder.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Initiating service 3 cleanup Jun 23 13:52:07 devstack cinder-volume[93605]: INFO cinder.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Service 3 cleanup completed. Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.service [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Creating RPC server for service cinder-volume {{(pid=93605) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.service [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93605) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 13:52:07 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:52:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:52:07 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:52:07 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:52:08 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Jun 23 13:52:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.644s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:52:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4b1eb2b7-21cf-4b78-beaa-6ed44a200d24 None None] Driver post RPC initialization completed successfully. Jun 23 13:52:16 devstack cinder-volume[93408]: DEBUG dbcounter [-] [93408] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93408) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:52:17 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=3 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:52:18 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:52:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:52:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 6 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:52:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:53:50 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:53:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Flow 'volume_create_manager' (3ab91303-1b83-44e7-91d1-b7e4972f929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:53:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d884c55-3f22-4810-8a6d-a2ee4d8560f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d884c55-3f22-4810-8a6d-a2ee4d8560f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1058792340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5beb98-d70c-4716-a42d-c0c48020f202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2e999a2f8a4a199de78dbbb2382481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:53:51Z,use_quota=True,user_id='1ce616ef1b474fa48301d6fc9c8a6dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15de40a9-511d-4847-bdbe-e888ed5db5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15de40a9-511d-4847-bdbe-e888ed5db5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd7bc05-78fc-4a6d-af48-da95c6e79e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd7bc05-78fc-4a6d-af48-da95c6e79e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5beb98-d70c-4716-a42d-c0c48020f202', 'volume_name': 'volume-ed5beb98-d70c-4716-a42d-c0c48020f202', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3012423-caf4-4231-8160-a4b0ee3f668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3012423-caf4-4231-8160-a4b0ee3f668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f56a9d-5b04-4f9c-8415-a89382c5d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:51 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Volume ed5beb98-d70c-4716-a42d-c0c48020f202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5beb98-d70c-4716-a42d-c0c48020f202', 'volume_size': 1} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1058792340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5beb98-d70c-4716-a42d-c0c48020f202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a2e999a2f8a4a199de78dbbb2382481',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:53:51Z,use_quota=True,user_id='1ce616ef1b474fa48301d6fc9c8a6dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Creating volume ed5beb98-d70c-4716-a42d-c0c48020f202 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:53:51 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:51 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 1073741824 Jun 23 13:53:51 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:51 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:53:51 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Flow 'volume_create_manager' (3d2ab502-ed19-4f0b-836b-af3d87c2d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0009be53-8897-4d4f-80ce-4dd7f924b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:53 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.656s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:53:53 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0009be53-8897-4d4f-80ce-4dd7f924b8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1870409983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95473495-fdc7-4be1-99e7-bcd4af10f6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5fbda436f1497d8ff172df0898efa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:53:53Z,use_quota=True,user_id='98023c136e564bad8fe0cd0e8ac8d89c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af20284-71c2-4588-ad2d-160e19a9c920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af20284-71c2-4588-ad2d-160e19a9c920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fba5a66-3124-47a4-8b5a-dad4c7d4267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fba5a66-3124-47a4-8b5a-dad4c7d4267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95473495-fdc7-4be1-99e7-bcd4af10f6eb', 'volume_name': 'volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33464e3a-5528-4fb6-b4e3-eee9e31513ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33464e3a-5528-4fb6-b4e3-eee9e31513ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ba2752-751e-4824-89ab-783af6b658f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Volume 95473495-fdc7-4be1-99e7-bcd4af10f6eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb', 'volume_size': 1} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 1073741824" returned: 0 in 2.364s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 6 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:53:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:53 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 Jun 23 13:53:53 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:54 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202" returned: 0 in 1.101s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] <== create_volume: return (3615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.623s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1870409983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95473495-fdc7-4be1-99e7-bcd4af10f6eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5fbda436f1497d8ff172df0898efa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:53:53Z,use_quota=True,user_id='98023c136e564bad8fe0cd0e8ac8d89c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Creating volume 95473495-fdc7-4be1-99e7-bcd4af10f6eb {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:53:54 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:54 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb 1073741824 Jun 23 13:53:54 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f56a9d-5b04-4f9c-8415-a89382c5d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5beb98-d70c-4716-a42d-c0c48020f202', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2abc7cd-6426-4405-9fe3-d51dce7571a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:54 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Volume volume-ed5beb98-d70c-4716-a42d-c0c48020f202 (ed5beb98-d70c-4716-a42d-c0c48020f202): created successfully Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2abc7cd-6426-4405-9fe3-d51dce7571a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Flow 'volume_create_manager' (3ab91303-1b83-44e7-91d1-b7e4972f929f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:53:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fcab0572-97a8-429d-94f9-d68225361431 tempest-DeleteServersTestJSON-1739790752 None] Created volume successfully. Jun 23 13:53:56 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb 1073741824" returned: 0 in 2.089s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:53:56 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb Jun 23 13:53:56 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:53:58 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb" returned: 0 in 1.740s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] <== create_volume: return (3906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.913s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ba2752-751e-4824-89ab-783af6b658f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8274715-c154-456f-955c-7dfeeb2d2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:53:58 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Volume volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb (95473495-fdc7-4be1-99e7-bcd4af10f6eb): created successfully Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8274715-c154-456f-955c-7dfeeb2d2383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:53:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Flow 'volume_create_manager' (3d2ab502-ed19-4f0b-836b-af3d87c2d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:53:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-af8f32b2-4bde-4c27-8efe-553630f74e6d tempest-VolumesAdminNegativeTest-491054477 None] Created volume successfully. Jun 23 13:54:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Acquiring lock "cinder-95473495-fdc7-4be1-99e7-bcd4af10f6eb-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Lock "cinder-95473495-fdc7-4be1-99e7-bcd4af10f6eb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Acquiring lock "cinder-quobyte-95473495-fdc7-4be1-99e7-bcd4af10f6eb" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Lock "cinder-quobyte-95473495-fdc7-4be1-99e7-bcd4af10f6eb" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:01 devstack cinder-volume[93605]: INFO oslo.privsep.daemon [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr2v1txl9/privsep.sock'] Jun 23 13:54:01 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr2v1txl9/privsep.sock Jun 23 13:54:01 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:03 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Flow 'volume_create_manager' (bbc20e6d-53c7-468e-b0ba-c4ea879055f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ebc2c4-547e-4d69-9ae7-7d3f5c6c64ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ebc2c4-547e-4d69-9ae7-7d3f5c6c64ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1201277582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2a653e-e906-49e9-892b-be3dd4e661c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017d1c10f04e440a9b1405c8e298e400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:03Z,use_quota=True,user_id='37ce0ba611224b7686a84e8ec0d6544a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a696083-965c-4752-a702-4b0f24c63d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a696083-965c-4752-a702-4b0f24c63d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f1be2d-43bb-40c4-8594-597b9f69b9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f1be2d-43bb-40c4-8594-597b9f69b9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2a653e-e906-49e9-892b-be3dd4e661c0', 'volume_name': 'volume-ae2a653e-e906-49e9-892b-be3dd4e661c0', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fac4e1b-486a-40cf-b48e-fcf5c035eb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fac4e1b-486a-40cf-b48e-fcf5c035eb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0129151d-c7a1-43e2-9b89-a66eb0e9afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:04 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Volume ae2a653e-e906-49e9-892b-be3dd4e661c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2a653e-e906-49e9-892b-be3dd4e661c0', 'volume_size': 1} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1201277582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2a653e-e906-49e9-892b-be3dd4e661c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017d1c10f04e440a9b1405c8e298e400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:03Z,use_quota=True,user_id='37ce0ba611224b7686a84e8ec0d6544a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Creating volume ae2a653e-e906-49e9-892b-be3dd4e661c0 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:54:04 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:54:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:04 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 1073741824 Jun 23 13:54:04 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 13:54:04 devstack cinder-volume[93605]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 13:54:05 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:05 devstack cinder-volume[93605]: INFO oslo.privsep.daemon [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Spawned new privsep daemon via rootwrap Jun 23 13:54:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Accepted privsep connection to /tmp/tmpr2v1txl9/privsep.sock {{(pid=93605) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 13:54:05 devstack cinder-volume[93605]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 13:54:05 devstack cinder-volume[93605]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 13:54:05 devstack cinder-volume[93605]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 13:54:05 devstack cinder-volume[93605]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94994 Jun 23 13:54:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670631e-31ef-4b12-bb23-8f2a25cb9c18]: (2,) {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7d94fd-28b4-4347-9042-b99e57f2a9c2]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:05 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb Jun 23 13:54:05 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:06 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 1073741824" returned: 0 in 2.152s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:06 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 Jun 23 13:54:06 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:06 devstack cinder-volume[93605]: WARNING py.warnings [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 23 13:54:06 devstack cinder-volume[93605]: .first() Jun 23 13:54:06 devstack cinder-volume[93605]: Jun 23 13:54:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:07 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb" returned: 0 in 1.730s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:07 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb Jun 23 13:54:07 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:08 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0" returned: 0 in 1.898s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] <== create_volume: return (4261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.268s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.655s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[19425a48-3dda-437b-938f-faf14d150368]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0129151d-c7a1-43e2-9b89-a66eb0e9afc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2a653e-e906-49e9-892b-be3dd4e661c0', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0416600-26c5-4a0a-ba82-3ed3e63510ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:08 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Volume volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 (ae2a653e-e906-49e9-892b-be3dd4e661c0): created successfully Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0416600-26c5-4a0a-ba82-3ed3e63510ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Flow 'volume_create_manager' (bbc20e6d-53c7-468e-b0ba-c4ea879055f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:08 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 Jun 23 13:54:08 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8e49363a-274f-4df0-b13c-6fc1e1e98473 tempest-ServerActionsTestOtherA-1594235920 None] Created volume successfully. Jun 23 13:54:09 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95473495-fdc7-4be1-99e7-bcd4af10f6eb" returned: 0 in 1.946s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Lock "cinder-quobyte-95473495-fdc7-4be1-99e7-bcd4af10f6eb" released by "delete_volume" :: held 7.694s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:09 devstack cinder-volume[93605]: WARNING cinder.quota [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:54:09 devstack cinder-volume[93605]: WARNING cinder.quota [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Created reservations ['7f19465e-9119-4f48-8963-18991fb029c3', '004eb413-46d6-42d1-9124-b973c1dcaab8', '0c64e771-d98a-4ccd-9442-7b1ab7357af6', '91f55152-69a9-4dc1-abe2-6e3e486914ec'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:09 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:54:09 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:09 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202" returned: 0 in 1.529s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.639s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-ed5beb98-d70c-4716-a42d-c0c48020f202', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd3447f8-4783-43fb-ae68-7102d3abc8c5', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:54:10 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-0663c299-a5e8-477d-a59e-eaa5b0d16bcf req-0b0ecd4c-de2a-47bb-a96c-b938ead04920 tempest-DeleteServersTestJSON-1739790752 None] attachment_update completed successfully. Jun 23 13:54:10 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.063s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:10 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:54:10 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Deleted volume successfully. Jun 23 13:54:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e9f1518-61bf-4326-b345-ffac67c60193 tempest-VolumesAdminNegativeTest-491054477 None] Lock "cinder-95473495-fdc7-4be1-99e7-bcd4af10f6eb-delete_volume" released by "delete_volume" :: held 9.284s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:20 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=13,cinder:DELETE=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:54:20 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=25,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:54:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-affb5c6a-1b52-4e9c-b624-26f3e15d22e9 req-cdefe2e5-11b6-4a1a-83c9-702dd0c0a0b2 tempest-DeleteServersTestJSON-1739790752 None] Terminate volume connection completed successfully. Jun 23 13:54:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-affb5c6a-1b52-4e9c-b624-26f3e15d22e9 req-cdefe2e5-11b6-4a1a-83c9-702dd0c0a0b2 tempest-DeleteServersTestJSON-1739790752 None] Deleting attachment cd3447f8-4783-43fb-ae68-7102d3abc8c5. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:54:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Acquiring lock "cinder-ed5beb98-d70c-4716-a42d-c0c48020f202-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Lock "cinder-ed5beb98-d70c-4716-a42d-c0c48020f202-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Acquiring lock "cinder-quobyte-ed5beb98-d70c-4716-a42d-c0c48020f202" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:54:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Lock "cinder-quobyte-ed5beb98-d70c-4716-a42d-c0c48020f202" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:54:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[06151c2f-1c61-4a33-922c-4ac86a073a54]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:54:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:30 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 Jun 23 13:54:30 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:31 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202" returned: 0 in 1.018s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:31 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202 Jun 23 13:54:31 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:32 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ed5beb98-d70c-4716-a42d-c0c48020f202" returned: 0 in 0.866s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Lock "cinder-quobyte-ed5beb98-d70c-4716-a42d-c0c48020f202" released by "delete_volume" :: held 1.933s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Created reservations ['7659ec3b-9222-486c-9c10-fffa41aee84f', '6889220b-ffe6-4a25-97c2-c3a01833886a', '26678e64-d43f-4fcb-bd14-c71a45073693', '32af6324-52c7-440e-b856-de28593723c1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:32 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:54:32 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:33 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.940s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:33 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:54:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Deleted volume successfully. Jun 23 13:54:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-25ba0c21-0b94-4a5b-aba2-e990b6ec524b tempest-DeleteServersTestJSON-1739790752 None] Lock "cinder-ed5beb98-d70c-4716-a42d-c0c48020f202-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:54:34 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Flow 'volume_create_manager' (5e1753a0-49f2-47ae-b411-d1c89812f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c348ad27-9070-4526-883c-214b68e5453c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c348ad27-9070-4526-883c-214b68e5453c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1771439121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65224e9-35a0-4e34-9fc6-8a17b418fddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7c445c55a24971b83d5c3e8a416434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:35Z,use_quota=True,user_id='319f0350351f4aada756cc1f80aa1fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f54ddc1-7cb7-4e18-bc13-69a70c874430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f54ddc1-7cb7-4e18-bc13-69a70c874430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658380e1-f84b-48b9-bda7-5978f9323b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658380e1-f84b-48b9-bda7-5978f9323b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65224e9-35a0-4e34-9fc6-8a17b418fddc', 'volume_name': 'volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fb3555-f7db-4cb8-9c76-c8372ded885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fb3555-f7db-4cb8-9c76-c8372ded885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fef5ccb-eab8-439d-a965-b157f9dee4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Volume d65224e9-35a0-4e34-9fc6-8a17b418fddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc', 'volume_size': 1} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1771439121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65224e9-35a0-4e34-9fc6-8a17b418fddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd7c445c55a24971b83d5c3e8a416434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:54:35Z,use_quota=True,user_id='319f0350351f4aada756cc1f80aa1fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Creating volume d65224e9-35a0-4e34-9fc6-8a17b418fddc {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:54:35 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:54:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:35 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc 1073741824 Jun 23 13:54:35 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:36 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc 1073741824" returned: 0 in 1.344s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:36 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc Jun 23 13:54:36 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:37 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc" returned: 0 in 1.031s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.463s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fef5ccb-eab8-439d-a965-b157f9dee4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ee9ac-d03a-4694-a2d4-ca362d52c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:54:37 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Volume volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc (d65224e9-35a0-4e34-9fc6-8a17b418fddc): created successfully Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628ee9ac-d03a-4694-a2d4-ca362d52c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:54:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Flow 'volume_create_manager' (5e1753a0-49f2-47ae-b411-d1c89812f29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:54:37 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a61d2fdd-2b79-4b0a-b4c9-fec43cf8a91b tempest-TaggedAttachmentsTest-1583059248 None] Created volume successfully. Jun 23 13:54:47 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:54:47 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:54:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:54:51 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:54:51 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:54:52 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jun 23 13:54:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.242s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:54:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:54:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:54:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:54:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:55:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff136e60-5738-4d4b-8076-96f755f8d2bf]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:55:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:20 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 Jun 23 13:55:20 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:21 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0" returned: 0 in 1.671s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.716s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-ae2a653e-e906-49e9-892b-be3dd4e661c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e44ca5fc-c074-4cea-8e07-fca5527d4921', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:55:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-e5f16dfc-7fe8-406c-923a-11d6ea9fcce8 req-bc9805e1-0fd9-461d-935b-aa838d19032f tempest-ServerActionsTestOtherA-1594235920 None] attachment_update completed successfully. Jun 23 13:55:31 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:55:31 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:55:36 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-f3747a3c-565d-4cb2-9f36-794553fe0aa6 tempest-ServerActionsTestOtherA-1594235920 None] Terminate volume connection completed successfully. Jun 23 13:55:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-f3747a3c-565d-4cb2-9f36-794553fe0aa6 tempest-ServerActionsTestOtherA-1594235920 None] Deleting attachment e44ca5fc-c074-4cea-8e07-fca5527d4921. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:55:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:39 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b952a5f-dce6-4e8d-a425-3f1ad12b8743]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:55:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:40 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 Jun 23 13:55:40 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:42 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0" returned: 0 in 2.968s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.048s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-ae2a653e-e906-49e9-892b-be3dd4e661c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f22bf476-6ef7-4d45-bbcd-0bd112f98ba1', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:55:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-a4068177-6378-4db2-bf58-46aff224a1f5 req-bcf82f36-22fa-4277-829b-7774ca5ba455 tempest-ServerActionsTestOtherA-1594235920 None] attachment_update completed successfully. Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:51 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:55:51 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:52 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:55:52 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=8 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:55:53 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.904s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:55:53 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:55:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:55:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Flow 'volume_create_manager' (2d31dba6-2146-475e-aee0-533e76f34b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9319c33d-8ac9-429d-996f-6226d2adb345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9319c33d-8ac9-429d-996f-6226d2adb345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-760702926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6142c5-3aad-410f-9919-5ab51338ca2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e8a626044249b8bd46028c12c52055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:55Z,use_quota=True,user_id='1a20070bd3fb46daa3e35e48fc121e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3fe0b9-0328-4a53-b60a-de9647c07456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3fe0b9-0328-4a53-b60a-de9647c07456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5de56-ca2c-4935-991d-cee4198eaf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e5de56-ca2c-4935-991d-cee4198eaf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6142c5-3aad-410f-9919-5ab51338ca2c', 'volume_name': 'volume-5a6142c5-3aad-410f-9919-5ab51338ca2c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d78d9c5-7778-4144-9c92-612eeebe08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d78d9c5-7778-4144-9c92-612eeebe08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dabd3fd-b151-407a-a3cd-f1141ca4c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:55:55 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Volume 5a6142c5-3aad-410f-9919-5ab51338ca2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6142c5-3aad-410f-9919-5ab51338ca2c', 'volume_size': 1} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-760702926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6142c5-3aad-410f-9919-5ab51338ca2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e8a626044249b8bd46028c12c52055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:55:55Z,use_quota=True,user_id='1a20070bd3fb46daa3e35e48fc121e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Creating volume 5a6142c5-3aad-410f-9919-5ab51338ca2c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:55:55 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:55:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:55 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c 1073741824 Jun 23 13:55:55 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:55:58 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jun 23 13:55:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c 1073741824" returned: 0 in 2.504s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:55:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:55:58 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c Jun 23 13:55:58 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:00 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c" returned: 0 in 1.835s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] <== create_volume: return (4476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.479s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dabd3fd-b151-407a-a3cd-f1141ca4c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6142c5-3aad-410f-9919-5ab51338ca2c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b3c2a2-000b-4726-9874-f619971c08ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:00 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Volume volume-5a6142c5-3aad-410f-9919-5ab51338ca2c (5a6142c5-3aad-410f-9919-5ab51338ca2c): created successfully Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b3c2a2-000b-4726-9874-f619971c08ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Flow 'volume_create_manager' (2d31dba6-2146-475e-aee0-533e76f34b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:56:00 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0cbf4082-de39-4fbd-af7a-e4f91ba9a4e4 tempest-ServerRescueNegativeTestJSON-409696530 None] Created volume successfully. Jun 23 13:56:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:09 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf50304-a7a2-40a5-9688-fe441fd38972]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:10 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc Jun 23 13:56:10 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:11 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc" returned: 0 in 2.308s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.355s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75d9d662-60e7-4989-bfc0-5083a1b07950', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:56:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-7bf783f4-a8aa-42c0-8db5-9c13c3ff22dd req-9e41d472-1cf1-474e-8b55-8f0553692ecb tempest-TaggedAttachmentsTest-1583059248 None] attachment_update completed successfully. Jun 23 13:56:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-581e9a80-31cc-4d55-8a3b-99633ed23e15 req-e84404f9-2ef4-4226-b7b7-5a581dad8b16 tempest-TaggedAttachmentsTest-1583059248 None] Terminate volume connection completed successfully. Jun 23 13:56:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-581e9a80-31cc-4d55-8a3b-99633ed23e15 req-e84404f9-2ef4-4226-b7b7-5a581dad8b16 tempest-TaggedAttachmentsTest-1583059248 None] Deleting attachment 75d9d662-60e7-4989-bfc0-5083a1b07950. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:56:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-30474706-366c-4b2a-a574-9234f51a69ef req-05f74913-1f0a-489f-81c6-1e6652de50ae tempest-ServerActionsTestOtherA-1594235920 None] Terminate volume connection completed successfully. Jun 23 13:56:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-30474706-366c-4b2a-a574-9234f51a69ef req-05f74913-1f0a-489f-81c6-1e6652de50ae tempest-ServerActionsTestOtherA-1594235920 None] Deleting attachment f22bf476-6ef7-4d45-bbcd-0bd112f98ba1. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Flow 'volume_create_manager' (92d6c85a-f376-4bc3-83f0-9459bf056af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69da061f-d93c-4462-b9b7-18af5806c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69da061f-d93c-4462-b9b7-18af5806c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2122866092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc07e67-6ad0-4035-93d4-c65fc4000056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370a0a1d772468da7ca915120fc585e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:56:29Z,use_quota=True,user_id='d26ad9e4309d4e1e96e93384c77e72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb61761-34a0-4d35-a40e-84b426712b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb61761-34a0-4d35-a40e-84b426712b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14517f81-7f8c-4ac1-941e-c4182a12f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14517f81-7f8c-4ac1-941e-c4182a12f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc07e67-6ad0-4035-93d4-c65fc4000056', 'volume_name': 'volume-ecc07e67-6ad0-4035-93d4-c65fc4000056', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7baf10f-fc10-4d98-af4e-804614a90bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7baf10f-fc10-4d98-af4e-804614a90bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4832a6-d686-4776-88ac-174ce2873587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:28 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Volume ecc07e67-6ad0-4035-93d4-c65fc4000056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc07e67-6ad0-4035-93d4-c65fc4000056', 'volume_size': 1} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2122866092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc07e67-6ad0-4035-93d4-c65fc4000056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370a0a1d772468da7ca915120fc585e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:56:29Z,use_quota=True,user_id='d26ad9e4309d4e1e96e93384c77e72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Creating volume ecc07e67-6ad0-4035-93d4-c65fc4000056 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:56:28 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:56:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:29 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 1073741824 Jun 23 13:56:29 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Acquiring lock "cinder-5a6142c5-3aad-410f-9919-5ab51338ca2c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "cinder-5a6142c5-3aad-410f-9919-5ab51338ca2c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Acquiring lock "cinder-quobyte-5a6142c5-3aad-410f-9919-5ab51338ca2c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "cinder-quobyte-5a6142c5-3aad-410f-9919-5ab51338ca2c" acquired by "delete_volume" :: waited 0.048s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124106a-aa46-4e5c-aa1c-83b3747558f6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:29 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c Jun 23 13:56:29 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:30 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 1073741824" returned: 0 in 1.779s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:30 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 Jun 23 13:56:30 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:31 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c" returned: 0 in 1.656s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:31 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c Jun 23 13:56:31 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:32 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6142c5-3aad-410f-9919-5ab51338ca2c" returned: 0 in 1.465s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "cinder-quobyte-5a6142c5-3aad-410f-9919-5ab51338ca2c" released by "delete_volume" :: held 3.197s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:32 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Created reservations ['5476341a-1f4a-46b7-bf1f-635f449bc371', 'abb2fbb5-3939-4d04-a27a-76bd051185bd', '82aa274f-639f-4b43-8708-452ea194b79a', '90e37fa9-7e0d-477f-a1bd-0d7c5460c4ee'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056" returned: 0 in 1.891s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] <== create_volume: return (3814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.818s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4832a6-d686-4776-88ac-174ce2873587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc07e67-6ad0-4035-93d4-c65fc4000056', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f0b07f-4560-475d-bf54-dd70e4f43c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:32 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Volume volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 (ecc07e67-6ad0-4035-93d4-c65fc4000056): created successfully Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f0b07f-4560-475d-bf54-dd70e4f43c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Flow 'volume_create_manager' (92d6c85a-f376-4bc3-83f0-9459bf056af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:56:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-657162d6-748f-485a-bb10-d91316d4d9f7 tempest-ServersNegativeTestJSON-1864666285 None] Created volume successfully. Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:32 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:56:32 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:34 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.086s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:34 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:34 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Deleted volume successfully. Jun 23 13:56:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2c48d6bf-e8a1-4b63-a18c-27573c20e366 tempest-ServerRescueNegativeTestJSON-409696530 None] Lock "cinder-5a6142c5-3aad-410f-9919-5ab51338ca2c-delete_volume" released by "delete_volume" :: held 4.815s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Flow 'volume_create_manager' (21f16adc-38ad-4e40-8b45-e336aacfc558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a159446f-ee4a-4e91-a351-3dd0642836c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a159446f-ee4a-4e91-a351-3dd0642836c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-835511562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc4c77d-3a73-4c37-842a-049b4ab0c4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370a0a1d772468da7ca915120fc585e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:56:38Z,use_quota=True,user_id='d26ad9e4309d4e1e96e93384c77e72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255e1449-d66f-4131-a02d-2c1adb04bc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255e1449-d66f-4131-a02d-2c1adb04bc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf4143a-9567-4111-adeb-623ed928c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:37 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf4143a-9567-4111-adeb-623ed928c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc4c77d-3a73-4c37-842a-049b4ab0c4d2', 'volume_name': 'volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91303869-94ce-4fca-8dbb-178c9ebacfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91303869-94ce-4fca-8dbb-178c9ebacfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db7b470-f483-42f1-97c9-003a7b4a317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Volume 8cc4c77d-3a73-4c37-842a-049b4ab0c4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2', 'volume_size': 1} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-835511562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc4c77d-3a73-4c37-842a-049b4ab0c4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370a0a1d772468da7ca915120fc585e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:56:38Z,use_quota=True,user_id='d26ad9e4309d4e1e96e93384c77e72c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Creating volume 8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:56:38 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:56:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:38 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 1073741824 Jun 23 13:56:38 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:39 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 1073741824" returned: 0 in 1.760s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:39 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 Jun 23 13:56:39 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "cinder-ae2a653e-e906-49e9-892b-be3dd4e661c0-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Lock "cinder-ae2a653e-e906-49e9-892b-be3dd4e661c0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:40 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2" returned: 0 in 1.121s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] <== create_volume: return (2958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:56:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.963s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "cinder-quobyte-ae2a653e-e906-49e9-892b-be3dd4e661c0" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db7b470-f483-42f1-97c9-003a7b4a317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fb9659-cd73-4d4b-952b-cb2a8d19a9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Lock "cinder-quobyte-ae2a653e-e906-49e9-892b-be3dd4e661c0" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:41 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Volume volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 (8cc4c77d-3a73-4c37-842a-049b4ab0c4d2): created successfully Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fb9659-cd73-4d4b-952b-cb2a8d19a9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Flow 'volume_create_manager' (21f16adc-38ad-4e40-8b45-e336aacfc558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec851cc9-84b6-4dee-8d2c-728cbb0c8f70]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:41 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-44eb97f2-aa83-4e96-9e85-d6363cb233a7 tempest-ServersNegativeTestJSON-1864666285 None] Created volume successfully. Jun 23 13:56:41 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 Jun 23 13:56:41 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:41 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0" returned: 0 in 0.869s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:41 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0 Jun 23 13:56:41 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "cinder-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "cinder-quobyte-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-quobyte-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eebb8d-c9ed-4090-a6ef-0cf65935c48b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:42 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ae2a653e-e906-49e9-892b-be3dd4e661c0" returned: 0 in 0.864s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Lock "cinder-quobyte-ae2a653e-e906-49e9-892b-be3dd4e661c0" released by "delete_volume" :: held 1.805s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:42 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Created reservations ['8ed36f16-a9ab-472b-8d70-d36cf4d2c56a', 'b0341653-6185-451c-99e0-bf4ddc0a15cb', '0d859d0f-a88f-4fad-9779-86a33ea501c7', '85649c39-f106-4884-b79b-612257a820d1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:56:42 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 Jun 23 13:56:42 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:43 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:56:43 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:43 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2" returned: 0 in 1.157s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:43 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2 Jun 23 13:56:43 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:44 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.003s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:44 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Deleted volume successfully. Jun 23 13:56:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-027cf6f2-c5f8-42c9-a092-f7baf6b81cd3 tempest-ServerActionsTestOtherA-1594235920 None] Lock "cinder-ae2a653e-e906-49e9-892b-be3dd4e661c0-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2" returned: 0 in 1.455s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-quobyte-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2" released by "delete_volume" :: held 2.679s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Created reservations ['109125f2-5450-46f7-8b64-5bc02ddcc531', 'f3e7a8e7-b990-4cc7-b294-942e24eb81a8', 'e08bbac5-e6aa-43a0-b199-06a829fe344c', 'f4f1943e-5302-4736-a391-c6fd76d054ab'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:45 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:56:45 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "cinder-ecc07e67-6ad0-4035-93d4-c65fc4000056-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-ecc07e67-6ad0-4035-93d4-c65fc4000056-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "cinder-quobyte-ecc07e67-6ad0-4035-93d4-c65fc4000056" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-quobyte-ecc07e67-6ad0-4035-93d4-c65fc4000056" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1992cf-0591-4a05-ba02-9bc676fe6239]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:46 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 Jun 23 13:56:46 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.180s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:46 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:46 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Deleted volume successfully. Jun 23 13:56:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5439d1b3-0f86-47b3-a4c3-9f91d8a604cd tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-8cc4c77d-3a73-4c37-842a-049b4ab0c4d2-delete_volume" released by "delete_volume" :: held 4.338s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:47 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056" returned: 0 in 1.232s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:47 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056 Jun 23 13:56:47 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Acquiring lock "cinder-d65224e9-35a0-4e34-9fc6-8a17b418fddc-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Lock "cinder-d65224e9-35a0-4e34-9fc6-8a17b418fddc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Acquiring lock "cinder-quobyte-d65224e9-35a0-4e34-9fc6-8a17b418fddc" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Lock "cinder-quobyte-d65224e9-35a0-4e34-9fc6-8a17b418fddc" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58007d9-77f3-4866-a698-6ca1b011fc5c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:48 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ecc07e67-6ad0-4035-93d4-c65fc4000056" returned: 0 in 1.214s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-quobyte-ecc07e67-6ad0-4035-93d4-c65fc4000056" released by "delete_volume" :: held 2.521s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:48 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc Jun 23 13:56:48 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Created reservations ['a317c7b6-173c-462c-967f-0d365a2f1869', 'be9f54ec-924b-44ea-98ee-53d302ea2f46', '0be99269-8e3b-447a-b91f-bf797f4e8465', 'c35a6bc0-ef98-4af8-bab6-5e23be8b8bac'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:48 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:56:48 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:49 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.797s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:49 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Deleted volume successfully. Jun 23 13:56:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d3ea7003-9cb7-4719-9138-1d3281982396 tempest-ServersNegativeTestJSON-1864666285 None] Lock "cinder-ecc07e67-6ad0-4035-93d4-c65fc4000056-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:49 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc" returned: 0 in 1.082s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:49 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc Jun 23 13:56:49 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:50 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d65224e9-35a0-4e34-9fc6-8a17b418fddc" returned: 0 in 0.796s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Lock "cinder-quobyte-d65224e9-35a0-4e34-9fc6-8a17b418fddc" released by "delete_volume" :: held 1.935s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Created reservations ['14524c67-2f8c-4dae-9274-a243eb4dc42b', '158b4262-42db-42ca-b47b-3aa05df72d46', 'cda08fa6-6db5-461e-80d2-62c3ff2edcd4', 'ea17e759-e3f7-405b-9ab6-887588f0e296'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:50 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:56:50 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:56:51 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:56:51 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:56:51 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.981s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Deleted volume successfully. Jun 23 13:56:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ddc3ba53-f8ad-4e73-8a25-8a70d21731cf tempest-TaggedAttachmentsTest-1583059248 None] Lock "cinder-d65224e9-35a0-4e34-9fc6-8a17b418fddc-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:56:52 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jun 23 13:56:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.064s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:56:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:56:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:56:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:56:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:57:00 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=40,cinder:UPDATE=53,cinder:INSERT=11,cinder:DELETE=3 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:57:01 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=38,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=5 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:57:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-302adebf-1fbe-4876-9a83-92676f532832 tempest-GroupSnapshotsV319Test-849175906 None] Group tempest-GroupSnapshotsV319Test-Group-1031925551: creating Jun 23 13:57:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-302adebf-1fbe-4876-9a83-92676f532832 tempest-GroupSnapshotsV319Test-849175906 None] Group tempest-GroupSnapshotsV319Test-Group-1031925551: created successfully Jun 23 13:57:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-302adebf-1fbe-4876-9a83-92676f532832 tempest-GroupSnapshotsV319Test-849175906 None] Create group completed successfully. Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Flow 'volume_create_manager' (0dd47e5a-c5c6-46d9-93b2-aa9d3f9279ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ea5d2c-9c7b-4de5-8974-d4f248acc46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ea5d2c-9c7b-4de5-8974-d4f248acc46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894879691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e52e025b-0a67-4b35-af33-bb0f4ae2c438,host='devstack@QuobyteHD#QuobyteHD',id=6d53d49c-e294-49e6-b309-8254dad04946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f034a426b91458490c45852b9c946ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:06Z,use_quota=True,user_id='0b5bffbdb22644a09f5a1bcb76045b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea7800c-1a5a-4060-9ae5-e0bebacf2bc3),volume_type_id=2ea7800c-1a5a-4060-9ae5-e0bebacf2bc3)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e21dd7c-6ea9-4aea-90d3-a6f6bcdaf16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e21dd7c-6ea9-4aea-90d3-a6f6bcdaf16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f93686-b341-4845-a0ad-3b8eba3f8e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f93686-b341-4845-a0ad-3b8eba3f8e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d53d49c-e294-49e6-b309-8254dad04946', 'volume_name': 'volume-6d53d49c-e294-49e6-b309-8254dad04946', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231fd94b-5435-4dbc-9f73-9eb907599a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231fd94b-5435-4dbc-9f73-9eb907599a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f9aaa0-a830-4e8e-b7bd-eaeaf4efe517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:05 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Volume 6d53d49c-e294-49e6-b309-8254dad04946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d53d49c-e294-49e6-b309-8254dad04946', 'volume_size': 1} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e52e025b-0a67-4b35-af33-bb0f4ae2c438,created_at=2026-06-23T11:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894879691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e52e025b-0a67-4b35-af33-bb0f4ae2c438,host='devstack@QuobyteHD#QuobyteHD',id=6d53d49c-e294-49e6-b309-8254dad04946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f034a426b91458490c45852b9c946ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:06Z,use_quota=True,user_id='0b5bffbdb22644a09f5a1bcb76045b28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ea7800c-1a5a-4060-9ae5-e0bebacf2bc3),volume_type_id=2ea7800c-1a5a-4060-9ae5-e0bebacf2bc3)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Creating volume 6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:05 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:57:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:05 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 1073741824 Jun 23 13:57:05 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:07 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 1073741824" returned: 0 in 1.663s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:07 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 Jun 23 13:57:07 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:08 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946" returned: 0 in 1.017s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] <== create_volume: return (2745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.748s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f9aaa0-a830-4e8e-b7bd-eaeaf4efe517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d53d49c-e294-49e6-b309-8254dad04946', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529c5cdb-6ed9-4bec-a607-46a4f302d3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:08 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Volume volume-6d53d49c-e294-49e6-b309-8254dad04946 (6d53d49c-e294-49e6-b309-8254dad04946): created successfully Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529c5cdb-6ed9-4bec-a607-46a4f302d3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Flow 'volume_create_manager' (0dd47e5a-c5c6-46d9-93b2-aa9d3f9279ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-028ccb2e-03c8-4bd8-8c20-07b036c32655 tempest-GroupSnapshotsV319Test-849175906 None] Created volume successfully. Jun 23 13:57:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] GroupSnapshot b5900854-9288-47c0-9545-f90306adb46e: creating. Jun 23 13:57:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Group snapshot b5900854-9288-47c0-9545-f90306adb46e: creating. {{(pid=93605) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 13:57:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Creating offline snapshot 72e38e76-487d-4dcc-9251-179dab1b52dd of volume 6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:57:10 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a7a24-95aa-44e8-883e-10b21200e566]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:10 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 Jun 23 13:57:10 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:11 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946" returned: 0 in 1.064s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:11 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd 1G Jun 23 13:57:11 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:12 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd 1G" returned: 0 in 1.214s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d53d49c-e294-49e6-b309-8254dad04946 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:12 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d53d49c-e294-49e6-b309-8254dad04946 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd Jun 23 13:57:12 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:13 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d53d49c-e294-49e6-b309-8254dad04946 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd" returned: 0 in 0.951s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:13 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:57:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:13 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd Jun 23 13:57:13 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:14 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd" returned: 0 in 0.878s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:14 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info Jun 23 13:57:14 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:14 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info" returned: 0 in 0.742s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:14 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:57:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:15 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info Jun 23 13:57:15 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:15 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.info" returned: 0 in 0.826s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.802s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6eb47cb5-3b7f-4e34-b472-e4db0f005b31 tempest-GroupSnapshotsV319Test-849175906 None] group_snapshot b5900854-9288-47c0-9545-f90306adb46e: created successfully Jun 23 13:57:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] group_snapshot b5900854-9288-47c0-9545-f90306adb46e: deleting Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] group_snapshot b5900854-9288-47c0-9545-f90306adb46e: deleting {{(pid=93605) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "cinder-quobyte-6d53d49c-e294-49e6-b309-8254dad04946" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Lock "cinder-quobyte-6d53d49c-e294-49e6-b309-8254dad04946" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "cinder-quobyte-72e38e76-487d-4dcc-9251-179dab1b52dd" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Lock "cinder-quobyte-72e38e76-487d-4dcc-9251-179dab1b52dd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Deleting offline snapshot 72e38e76-487d-4dcc-9251-179dab1b52dd of volume 6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] snapshot_file for this snap is: volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7fbd4c-8cb5-4ea1-a6f5-4cf8898184b1]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:17 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd Jun 23 13:57:17 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:18 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd" returned: 0 in 0.978s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d53d49c-e294-49e6-b309-8254dad04946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:57:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8ac5f-ec65-440b-b69b-8cac6cdef207]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:18 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 Jun 23 13:57:18 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:19 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946" returned: 0 in 1.030s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:19 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd Jun 23 13:57:19 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:20 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd" returned: 0 in 1.019s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:20 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd Jun 23 13:57:20 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:21 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946.72e38e76-487d-4dcc-9251-179dab1b52dd" returned: 0 in 0.813s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Lock "cinder-quobyte-72e38e76-487d-4dcc-9251-179dab1b52dd" released by "_delete_snapshot" :: held 3.974s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Lock "cinder-quobyte-6d53d49c-e294-49e6-b309-8254dad04946" released by "delete_snapshot" :: held 4.018s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:21 devstack cinder-volume[93605]: WARNING cinder.quota [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-819688338 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-819688338, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:57:21 devstack cinder-volume[93605]: WARNING cinder.quota [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-819688338 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-819688338, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:57:21 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] Created reservations ['0dff7178-eed3-4efa-8a7a-44f023cf9875', '60a1e7fd-8c25-4772-bb2a-3ca54b600d22', '789430ba-91bd-4118-bb70-8e7d60c5f361', '87296b53-20ef-42a3-803a-1468a8f9241a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-62edb00f-e906-4ae7-9ed5-42fcd8f53f5f tempest-GroupSnapshotsV319Test-849175906 None] group_snapshot b5900854-9288-47c0-9545-f90306adb46e: deleted successfully Jun 23 13:57:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "cinder-quobyte-6d53d49c-e294-49e6-b309-8254dad04946" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:57:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Lock "cinder-quobyte-6d53d49c-e294-49e6-b309-8254dad04946" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:57:22 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f78c8-483e-4c25-b0e9-1800eb4a207e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:57:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:22 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 Jun 23 13:57:22 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:23 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946" returned: 0 in 1.030s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:23 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946 Jun 23 13:57:23 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:24 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d53d49c-e294-49e6-b309-8254dad04946" returned: 0 in 0.865s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Lock "cinder-quobyte-6d53d49c-e294-49e6-b309-8254dad04946" released by "delete_volume" :: held 1.998s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Created reservations ['4add0680-9d1b-42cd-b041-4e5df8978f73'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:24 devstack cinder-volume[93605]: WARNING cinder.quota [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-819688338 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-819688338, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Created reservations ['fd9716d8-a4ba-40f7-8d07-0133b70addeb', 'be97310c-59fc-4d60-af62-9cbb793e7a4d', '93887d97-e0bf-4023-965a-87e1831b4489', '3923d0e8-6a4d-46f1-8e41-4c921ce21f19'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:24 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:57:24 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:25 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.822s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:25 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:25 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-66c46657-5ee9-4bcc-96c7-531ec5e85f4d tempest-GroupSnapshotsV319Test-849175906 None] Delete group completed successfully. Jun 23 13:57:34 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=24,cinder:SELECT=21,cinder:DELETE=1,cinder:INSERT=4 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:57:34 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=28,cinder:UPDATE=22,cinder:INSERT=7 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:51 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:57:51 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f04c7dd-62b9-419c-baf0-f5eb040cbe3a tempest-GroupsV314Test-271417820 None] Group tempest-GroupsV314Test-Group-661116055: creating Jun 23 13:57:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f04c7dd-62b9-419c-baf0-f5eb040cbe3a tempest-GroupsV314Test-271417820 None] Group tempest-GroupsV314Test-Group-661116055: created successfully Jun 23 13:57:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f04c7dd-62b9-419c-baf0-f5eb040cbe3a tempest-GroupsV314Test-271417820 None] Create group completed successfully. Jun 23 13:57:52 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.972s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:57:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:57:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:57:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Flow 'volume_create_manager' (66e6a2e0-8e08-40e7-bead-89e48bcad60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9a9bae-ffa2-4337-a156-887b78e3cedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9a9bae-ffa2-4337-a156-887b78e3cedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1643245440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93448a2-ea06-4196-89c1-bd3f9806709c,host='devstack@QuobyteHD#QuobyteHD',id=83380559-9820-44fe-8dbd-069867dd4e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ba16cae32140bbbaeddf2855e6f637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:54Z,use_quota=True,user_id='fad9acb4e24949ffa3bf62242a214f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd848e56-1f32-46a9-80ae-0cf03e438368),volume_type_id=dd848e56-1f32-46a9-80ae-0cf03e438368)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3851d957-844b-479c-a297-c57da358216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3851d957-844b-479c-a297-c57da358216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc757e-8e88-4913-ac46-9d9dc4b57003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfc757e-8e88-4913-ac46-9d9dc4b57003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83380559-9820-44fe-8dbd-069867dd4e65', 'volume_name': 'volume-83380559-9820-44fe-8dbd-069867dd4e65', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936feb4c-e9f0-4ebb-a36f-62c8996e3db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936feb4c-e9f0-4ebb-a36f-62c8996e3db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f917cc7c-14c1-4321-8fac-35d854cee349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Volume 83380559-9820-44fe-8dbd-069867dd4e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83380559-9820-44fe-8dbd-069867dd4e65', 'volume_size': 1} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e93448a2-ea06-4196-89c1-bd3f9806709c,created_at=2026-06-23T11:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1643245440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e93448a2-ea06-4196-89c1-bd3f9806709c,host='devstack@QuobyteHD#QuobyteHD',id=83380559-9820-44fe-8dbd-069867dd4e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1ba16cae32140bbbaeddf2855e6f637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:57:54Z,use_quota=True,user_id='fad9acb4e24949ffa3bf62242a214f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd848e56-1f32-46a9-80ae-0cf03e438368),volume_type_id=dd848e56-1f32-46a9-80ae-0cf03e438368)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Creating volume 83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:57:53 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:57:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:53 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 1073741824 Jun 23 13:57:53 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:55 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 1073741824" returned: 0 in 1.541s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:57:55 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:57:55 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:57:56 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 1.377s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] <== create_volume: return (3030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.044s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f917cc7c-14c1-4321-8fac-35d854cee349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83380559-9820-44fe-8dbd-069867dd4e65', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4db2c47-fa71-4497-a8d7-1b316f52cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:57:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Volume volume-83380559-9820-44fe-8dbd-069867dd4e65 (83380559-9820-44fe-8dbd-069867dd4e65): created successfully Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4db2c47-fa71-4497-a8d7-1b316f52cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:57:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Flow 'volume_create_manager' (66e6a2e0-8e08-40e7-bead-89e48bcad60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:57:56 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-10b02b8e-5cf9-40b0-9039-4b81b3bcaae7 tempest-GroupsV314Test-271417820 None] Created volume successfully. Jun 23 13:58:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:00 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Cloning volume 83380559-9820-44fe-8dbd-069867dd4e65 to volume 335247de-bf48-4f28-b00b-cf7d3ecab157 Jun 23 13:58:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Creating offline snapshot 41b78e5e-c582-4969-a539-993338bac7e6 of volume 83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:58:00 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fada28-59c3-4253-b20d-e306bef2fb73]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:01 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:58:01 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:03 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 2.300s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:03 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 1G Jun 23 13:58:03 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:06 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 1G" returned: 0 in 3.110s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83380559-9820-44fe-8dbd-069867dd4e65 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:06 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83380559-9820-44fe-8dbd-069867dd4e65 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 Jun 23 13:58:06 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:08 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83380559-9820-44fe-8dbd-069867dd4e65 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6" returned: 0 in 2.636s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:08 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:58:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:08 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 Jun 23 13:58:08 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:10 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6" returned: 0 in 1.499s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:10 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info Jun 23 13:58:10 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:11 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info" returned: 0 in 1.303s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:11 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:58:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:11 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info Jun 23 13:58:11 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:12 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.info" returned: 0 in 0.984s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Acquiring lock "cinder-quobyte-335247de-bf48-4f28-b00b-cf7d3ecab157" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-335247de-bf48-4f28-b00b-cf7d3ecab157" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] snapshot: 41b78e5e-c582-4969-a539-993338bac7e6, volume: 335247de-bf48-4f28-b00b-cf7d3ecab157, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9899a647-c3ee-489f-a43e-087b5238328a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:13 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 Jun 23 13:58:13 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:13 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6" returned: 0 in 0.995s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83380559-9820-44fe-8dbd-069867dd4e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:58:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 13:58:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 13:58:13 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a933cb-2dc3-498e-b574-c66fb9b78ef7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:14 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:58:14 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:14 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 1.018s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:14 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 13:58:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:15 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 Jun 23 13:58:15 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:20 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:58:20 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:58:21 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157" returned: 0 in 6.658s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb203f-a9e8-4e9e-803a-76927d199ac7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:21 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:58:21 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:22 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 1.091s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:22 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:58:22 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Converted 1024.00 MB image at 153.79 MB/s Jun 23 13:58:22 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 13:58:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:22 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 Jun 23 13:58:22 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:23 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157" returned: 0 in 0.796s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-335247de-bf48-4f28-b00b-cf7d3ecab157" released by "_copy_volume_from_snapshot" :: held 10.704s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Acquiring lock "cinder-quobyte-41b78e5e-c582-4969-a539-993338bac7e6" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-41b78e5e-c582-4969-a539-993338bac7e6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Deleting offline snapshot 41b78e5e-c582-4969-a539-993338bac7e6 of volume 83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] snapshot_file for this snap is: volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd82e5a-4e6a-4475-a7d6-059fa48b7349]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:23 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 Jun 23 13:58:23 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:24 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6" returned: 0 in 1.029s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83380559-9820-44fe-8dbd-069867dd4e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:58:24 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29f47e7-9913-4a05-b29f-872bbccc41df]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:24 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:58:24 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Flow 'volume_create_manager' (b07b42e7-c0e7-46c3-9013-7f524db62bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266561bd-4609-4332-b85d-59a792487c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266561bd-4609-4332-b85d-59a792487c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559175220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdda29a849464f84c0ae172a3a0e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:25Z,use_quota=True,user_id='fd3220a032f74cee814b047eff00c9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1a4d33-5b4c-4805-a473-dfa874f47596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1a4d33-5b4c-4805-a473-dfa874f47596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b7eeeb-8311-465f-97f5-121965021c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b7eeeb-8311-465f-97f5-121965021c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46', 'volume_name': 'volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eac42f-d37d-4458-ba89-b67a9a5df3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eac42f-d37d-4458-ba89-b67a9a5df3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3db664d-4bd6-42d0-9193-e05c3e04e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Volume 5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46', 'volume_size': 1} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:25 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 0.949s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:25 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 Jun 23 13:58:25 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:26 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6" returned: 0 in 0.747s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:26 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6 Jun 23 13:58:26 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:27 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65.41b78e5e-c582-4969-a539-993338bac7e6" returned: 0 in 0.730s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-41b78e5e-c582-4969-a539-993338bac7e6" released by "_delete_snapshot" :: held 3.577s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 26.590s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-559175220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdda29a849464f84c0ae172a3a0e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:25Z,use_quota=True,user_id='fd3220a032f74cee814b047eff00c9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Creating volume 5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:27 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:27 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 1073741824 Jun 23 13:58:27 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-42480d94-4d5d-4b9d-9e07-2005e3ba66d6 tempest-GroupsV314Test-271417820 None] Create group from source-group-e93448a2-ea06-4196-89c1-bd3f9806709c completed successfully. Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Flow 'volume_create_manager' (c05c4336-dfaf-45d7-9dbb-27362ca35e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11ad072-e30a-4d1a-b92b-3049259e719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11ad072-e30a-4d1a-b92b-3049259e719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1516534402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843709a8-a710-424b-87be-44e830cbced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ae67e1883429493e2ba441064076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:28Z,use_quota=True,user_id='b3444a4bfff044b9a61421cb68ef4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9ee707-916e-48ae-b466-bbb3365f7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9ee707-916e-48ae-b466-bbb3365f7248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08502f7a-9ef3-4c98-bfe9-37e12cbe0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08502f7a-9ef3-4c98-bfe9-37e12cbe0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843709a8-a710-424b-87be-44e830cbced1', 'volume_name': 'volume-843709a8-a710-424b-87be-44e830cbced1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c1c749-2f58-464f-8d36-352ce65f33b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c1c749-2f58-464f-8d36-352ce65f33b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28750ce1-8da0-4c18-886e-e475f7ac4408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:27 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Volume 843709a8-a710-424b-87be-44e830cbced1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843709a8-a710-424b-87be-44e830cbced1', 'volume_size': 1} Jun 23 13:58:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:28 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 1073741824" returned: 0 in 1.029s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:28 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 Jun 23 13:58:28 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Acquiring lock "cinder-quobyte-335247de-bf48-4f28-b00b-cf7d3ecab157" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-335247de-bf48-4f28-b00b-cf7d3ecab157" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:28 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938553e-b4c1-4259-a327-de4fa459bc48]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:28 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 Jun 23 13:58:28 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:29 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" returned: 0 in 0.854s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1516534402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843709a8-a710-424b-87be-44e830cbced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ae67e1883429493e2ba441064076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:28Z,use_quota=True,user_id='b3444a4bfff044b9a61421cb68ef4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Creating volume 843709a8-a710-424b-87be-44e830cbced1 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:29 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3db664d-4bd6-42d0-9193-e05c3e04e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:29 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 1073741824 Jun 23 13:58:29 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f395be5-a2dc-4c9f-97ed-b2cf23eec76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:29 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Volume volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 (5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46): created successfully Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f395be5-a2dc-4c9f-97ed-b2cf23eec76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Flow 'volume_create_manager' (b07b42e7-c0e7-46c3-9013-7f524db62bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d6debbf7-aef3-4f80-910d-00c6b9176b84 tempest-AttachVolumeNegativeTest-1318192135 None] Created volume successfully. Jun 23 13:58:29 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157" returned: 0 in 0.957s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:29 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157 Jun 23 13:58:29 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:30 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 1073741824" returned: 0 in 1.092s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:30 devstack sudo[99935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 Jun 23 13:58:30 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:30 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-335247de-bf48-4f28-b00b-cf7d3ecab157" returned: 0 in 0.928s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-335247de-bf48-4f28-b00b-cf7d3ecab157" released by "delete_volume" :: held 1.988s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Created reservations ['9f9755cb-77c0-4c4c-851b-06fae4e53b49'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:30 devstack cinder-volume[93605]: WARNING cinder.quota [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-920550538 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-920550538, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:58:30 devstack cinder-volume[93605]: WARNING cinder.quota [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-920550538 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-920550538, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Created reservations ['258755dd-c5c4-4c34-8556-06f72568c100', '6836b6d6-e63b-4aa2-806f-74ce6064a3fa', '2f513e79-3c97-4bac-87e0-6e139d569622', '104aa502-f3d9-44cc-980d-75554e598d0a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:30 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:58:30 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:31 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1" returned: 0 in 0.937s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28750ce1-8da0-4c18-886e-e475f7ac4408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843709a8-a710-424b-87be-44e830cbced1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efed99b-afc5-4ffe-96c9-e63f97d84e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Volume volume-843709a8-a710-424b-87be-44e830cbced1 (843709a8-a710-424b-87be-44e830cbced1): created successfully Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efed99b-afc5-4ffe-96c9-e63f97d84e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Flow 'volume_create_manager' (c05c4336-dfaf-45d7-9dbb-27362ca35e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f0cb5c51-d4e4-4b90-987a-4715243ef36b tempest-AttachVolumeTestJSON-1522754590 None] Created volume successfully. Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Acquiring lock "cinder-quobyte-83380559-9820-44fe-8dbd-069867dd4e65" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-83380559-9820-44fe-8dbd-069867dd4e65" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c7dcf-8ba0-4b44-8e50-dc1ea77a36ba]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Flow 'volume_create_manager' (58ef67f1-3dec-47b6-80e6-8ded72281d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e83c35-4840-4d61-855f-885379506c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:31 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:58:31 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e83c35-4840-4d61-855f-885379506c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-763781164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd36834-4360-41f2-816c-d430f435dd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7c1576081463d9f82328884069e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:32Z,use_quota=True,user_id='ba3c829ed8be4fe285683f2e4c8e9149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4bddee-8c31-47a6-a6c4-8c518b81e8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4bddee-8c31-47a6-a6c4-8c518b81e8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b93b3b9-5682-41d5-ab82-298b025f29ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b93b3b9-5682-41d5-ab82-298b025f29ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd36834-4360-41f2-816c-d430f435dd4d', 'volume_name': 'volume-edd36834-4360-41f2-816c-d430f435dd4d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fdfba5-726c-4f3c-9940-a0dcca1711d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fdfba5-726c-4f3c-9940-a0dcca1711d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bc4bbc-ffc2-499b-b93d-67fdffb9dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Volume edd36834-4360-41f2-816c-d430f435dd4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd36834-4360-41f2-816c-d430f435dd4d', 'volume_size': 1} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-763781164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd36834-4360-41f2-816c-d430f435dd4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d7c1576081463d9f82328884069e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:32Z,use_quota=True,user_id='ba3c829ed8be4fe285683f2e4c8e9149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Creating volume edd36834-4360-41f2-816c-d430f435dd4d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:31 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:31 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.944s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:31 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fcc5bbf1-8865-4c2a-ada9-a07a11226acf tempest-GroupsV314Test-271417820 None] Delete group completed successfully. Jun 23 13:58:31 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d 1073741824 Jun 23 13:58:31 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:32 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 0.987s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:32 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65 Jun 23 13:58:32 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:32 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d 1073741824" returned: 0 in 1.150s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:32 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d Jun 23 13:58:32 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:33 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83380559-9820-44fe-8dbd-069867dd4e65" returned: 0 in 0.756s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Lock "cinder-quobyte-83380559-9820-44fe-8dbd-069867dd4e65" released by "delete_volume" :: held 1.841s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Created reservations ['90e8777b-ea83-46a2-bc90-8fc05656ae9f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Created reservations ['e1feea45-bbca-4528-91aa-5cbdfdc6ba07', '0920bf77-099f-42b3-b1fd-6e467c05176f', 'b419765c-5659-4f2e-b756-1ae6ccf01a4f', 'f8bd48ff-3acb-4736-a184-c049a0eb5ef2'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:33 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:58:33 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:33 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d" returned: 0 in 0.710s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.771s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bc4bbc-ffc2-499b-b93d-67fdffb9dba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd36834-4360-41f2-816c-d430f435dd4d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd91d4f-5118-49f7-a976-2633922317bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a8f642-88f6-4287-9101-912f8fe27972]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:33 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Volume volume-edd36834-4360-41f2-816c-d430f435dd4d (edd36834-4360-41f2-816c-d430f435dd4d): created successfully Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd91d4f-5118-49f7-a976-2633922317bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Flow 'volume_create_manager' (58ef67f1-3dec-47b6-80e6-8ded72281d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-33f52798-3ee6-4df1-aa51-257cebe0859b tempest-AttachVolumeShelveTestJSON-803588905 None] Created volume successfully. Jun 23 13:58:33 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 Jun 23 13:58:33 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:34 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:34 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:34 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ff889108-a4e6-4c8a-8a20-a8360fd388d9 tempest-GroupsV314Test-271417820 None] Delete group completed successfully. Jun 23 13:58:34 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" returned: 0 in 1.044s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.078s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8d90989-d20b-470a-b39c-72fd305ae888', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:58:34 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-e6e2c23b-7893-4f9e-8374-73d7cc561c1f req-e0ba11d2-0fcb-43df-a8b2-75ca28b91f18 tempest-AttachVolumeNegativeTest-1318192135 None] attachment_update completed successfully. Jun 23 13:58:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b919b2-7801-4514-b5f0-99cc47b4f69c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:35 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 Jun 23 13:58:35 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:36 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1" returned: 0 in 1.217s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.258s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-843709a8-a710-424b-87be-44e830cbced1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b533c3d-88a1-46d1-99f1-83c337c37414', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:58:36 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-a57a2ec7-9d17-4a12-af18-a62e202ba820 req-31be7de6-6132-4e4f-98a4-7c96099c26e0 tempest-AttachVolumeTestJSON-1522754590 None] attachment_update completed successfully. Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Flow 'volume_create_manager' (6ae7a96e-0f40-4f5c-9ca6-220b57e52bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bfc37c-4471-4c15-9f6a-93b8dbea46f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bfc37c-4471-4c15-9f6a-93b8dbea46f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1402012236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109a7c74-58f0-4c66-9e55-faa476f7dd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea3dde9df3442d8b7703b515e892b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:42Z,use_quota=True,user_id='a6246718f7694f9e853c7f6dec1dd831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38489946-3bc3-4baf-937b-d27c7781b019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38489946-3bc3-4baf-937b-d27c7781b019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dac2b8-6dab-4ed3-92ff-237c033a533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dac2b8-6dab-4ed3-92ff-237c033a533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109a7c74-58f0-4c66-9e55-faa476f7dd68', 'volume_name': 'volume-109a7c74-58f0-4c66-9e55-faa476f7dd68', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fbb887-d0f5-499c-b2c8-b9510400e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fbb887-d0f5-499c-b2c8-b9510400e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacb95e4-6922-4172-a19e-6b175b57b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:41 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Volume 109a7c74-58f0-4c66-9e55-faa476f7dd68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109a7c74-58f0-4c66-9e55-faa476f7dd68', 'volume_size': 1} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1402012236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109a7c74-58f0-4c66-9e55-faa476f7dd68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea3dde9df3442d8b7703b515e892b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:58:42Z,use_quota=True,user_id='a6246718f7694f9e853c7f6dec1dd831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Creating volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:58:41 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 13:58:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:41 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 1073741824 Jun 23 13:58:41 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:43 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 1073741824" returned: 0 in 1.299s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:43 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 Jun 23 13:58:43 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:44 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68" returned: 0 in 1.328s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] <== create_volume: return (2683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.686s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bacb95e4-6922-4172-a19e-6b175b57b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109a7c74-58f0-4c66-9e55-faa476f7dd68', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225eaee7-eceb-478c-bcc7-af05e231e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:58:44 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Volume volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 (109a7c74-58f0-4c66-9e55-faa476f7dd68): created successfully Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225eaee7-eceb-478c-bcc7-af05e231e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:58:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Flow 'volume_create_manager' (6ae7a96e-0f40-4f5c-9ca6-220b57e52bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:58:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-659e8554-d940-46d3-ad61-64eac01cae70 tempest-SnapshotsActionsTest-1605228398 None] Created volume successfully. Jun 23 13:58:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Creating offline snapshot bc4bc329-d146-4230-8515-2565e62d07b9 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:58:45 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a1919-c295-41f4-a0f4-0511b6aba438]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:45 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 Jun 23 13:58:45 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:46 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68" returned: 0 in 1.185s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:46 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 1G Jun 23 13:58:46 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:47 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 1G" returned: 0 in 1.014s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:47 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:58:47 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:48 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 0.815s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:48 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 is being set with open permissions: ugo+rw Jun 23 13:58:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:48 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:58:48 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:49 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 0.732s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:49 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info Jun 23 13:58:49 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:49 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info" returned: 0 in 0.818s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:49 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info is being set with open permissions: ugo+rw Jun 23 13:58:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:49 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info Jun 23 13:58:49 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:50 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.info" returned: 0 in 0.774s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.485s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-67742917-616b-43ad-b82a-5dc36e28bd80 tempest-SnapshotsActionsTest-1605228398 None] Create snapshot completed successfully Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:51 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:58:51 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:58:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:58:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Creating offline snapshot 341e1fcd-3f03-49a4-8273-94544d217f5e of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:58:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc78e6a0-6810-411c-885c-7e6c278a853b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:52 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:58:52 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:53 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.438s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:58:53 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 1.245s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:58:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:53 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e 1G Jun 23 13:58:53 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-e04838d9-82fc-46bf-8f17-91ee0b467555 req-6bc5042d-ed92-4cb4-8684-e6213bec232b tempest-AttachVolumeShelveTestJSON-803588905 None] No connector for attachment 6059f5ba-8608-4af6-874c-18e441036727; skipping storage backend terminate_connection call. {{(pid=93605) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 13:58:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-e04838d9-82fc-46bf-8f17-91ee0b467555 req-6bc5042d-ed92-4cb4-8684-e6213bec232b tempest-AttachVolumeShelveTestJSON-803588905 None] Deleting attachment 6059f5ba-8608-4af6-874c-18e441036727. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:58:55 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e 1G" returned: 0 in 1.357s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:55 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e Jun 23 13:58:55 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:56 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e" returned: 0 in 1.385s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:56 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e is being set with open permissions: ugo+rw Jun 23 13:58:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:56 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e Jun 23 13:58:56 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:58:57 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jun 23 13:58:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e" returned: 0 in 1.293s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:58:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.523s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:58:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-10aeb467-0412-4055-a527-0af21ae72610 tempest-SnapshotsActionsTest-1605228398 None] Create snapshot completed successfully Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-341e1fcd-3f03-49a4-8273-94544d217f5e-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-341e1fcd-3f03-49a4-8273-94544d217f5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-341e1fcd-3f03-49a4-8273-94544d217f5e" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-341e1fcd-3f03-49a4-8273-94544d217f5e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Deleting offline snapshot 341e1fcd-3f03-49a4-8273-94544d217f5e of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] snapshot_file for this snap is: volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0993985-65d7-47cd-8800-c905fd2dd5d9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:58:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:58:59 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e Jun 23 13:58:59 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:00 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e" returned: 0 in 1.277s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:00 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a758c142-eded-4326-80bd-cac1f3d68fbc]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:01 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:01 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:02 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 1.269s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:02 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e Jun 23 13:59:02 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:03 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e" returned: 0 in 1.861s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:04 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e Jun 23 13:59:04 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:05 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.341e1fcd-3f03-49a4-8273-94544d217f5e" returned: 0 in 1.323s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-341e1fcd-3f03-49a4-8273-94544d217f5e" released by "_delete_snapshot" :: held 5.952s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" released by "delete_snapshot" :: held 6.014s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:05 devstack cinder-volume[93605]: WARNING cinder.quota [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 13:59:05 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Created reservations ['ec9e9305-6ba4-4a48-a551-137cb4c8c49c', '7e900cc5-9abe-4c88-85ef-099353b71985', 'e4d17599-112b-4056-8fdb-f9025967390a', 'e4f498d1-a31b-4587-b233-85eceba420f1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Delete snapshot completed successfully. Jun 23 13:59:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01e2db5f-05ac-4a5d-8919-9441b9813cbf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-341e1fcd-3f03-49a4-8273-94544d217f5e-delete_snapshot" released by "delete_snapshot" :: held 6.472s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Creating offline snapshot 75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:59:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206a16f-3059-4bb2-a6f7-d835a67488ef]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:07 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:07 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:08 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 2.028s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:09 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 1G Jun 23 13:59:09 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:11 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 1G" returned: 0 in 2.452s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:11 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 Jun 23 13:59:11 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:13 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" returned: 0 in 1.779s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:13 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 is being set with open permissions: ugo+rw Jun 23 13:59:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:13 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 Jun 23 13:59:13 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:14 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" returned: 0 in 0.851s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.348s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1a9460d1-4603-4f33-b253-d94aed7928a7 tempest-SnapshotsActionsTest-1605228398 None] Create snapshot completed successfully Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-75d63de9-2425-4a6f-8dba-7c4cc0bb97a0-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-75d63de9-2425-4a6f-8dba-7c4cc0bb97a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Deleting offline snapshot 75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] snapshot_file for this snap is: volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa6f55e-013a-49ac-9fe0-8a56a539e8d0]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:14 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 Jun 23 13:59:14 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:15 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" returned: 0 in 0.970s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:15 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f093bd3-5958-4c4b-9a2c-2a9783795dca]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:15 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:15 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:16 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 1.074s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:16 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 Jun 23 13:59:16 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:17 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" returned: 0 in 0.967s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:17 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0 Jun 23 13:59:17 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:18 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-75d63de9-2425-4a6f-8dba-7c4cc0bb97a0" released by "_delete_snapshot" :: held 4.018s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" released by "delete_snapshot" :: held 4.049s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:18 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Created reservations ['253fcf32-eadb-4873-bef4-a19a08a47f6f', 'd4e83386-501b-472c-acc1-a53ebf1fc8fb', '647c924a-8fed-4e77-a6a6-099c1331717d', 'bcfb3bc7-eacd-4cbf-85be-16513cbfd7a4'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:18 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Delete snapshot completed successfully. Jun 23 13:59:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-27c278a0-5cb3-488f-9b96-1014cd4a0044 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-75d63de9-2425-4a6f-8dba-7c4cc0bb97a0-delete_snapshot" released by "delete_snapshot" :: held 4.217s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Creating offline snapshot e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:59:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb895d22-f928-4c04-8cba-8361b334b39d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:19 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:19 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:20 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 0.920s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:20 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 1G Jun 23 13:59:20 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:21 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 1G" returned: 0 in 1.603s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:22 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 Jun 23 13:59:22 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:23 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" returned: 0 in 1.240s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:23 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 is being set with open permissions: ugo+rw Jun 23 13:59:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:23 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 Jun 23 13:59:23 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:24 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" returned: 0 in 1.078s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=64,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=63,cinder:SELECT=51,cinder:DELETE=6,cinder:INSERT=12 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.959s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d4024a72-be63-4cd8-a49e-55f20fd64a95 tempest-SnapshotsActionsTest-1605228398 None] Create snapshot completed successfully Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Deleting offline snapshot e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] snapshot_file for this snap is: volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5a50d-e0f5-46e0-bf82-df40149c46aa]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:25 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 Jun 23 13:59:25 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:26 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" returned: 0 in 1.246s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e963b25-e248-4247-82f4-143710817de4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:26 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:26 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:27 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 0.995s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:27 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 Jun 23 13:59:27 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:28 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" returned: 0 in 1.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:28 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8 Jun 23 13:59:28 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:29 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" returned: 0 in 0.787s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8" released by "_delete_snapshot" :: held 4.218s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" released by "delete_snapshot" :: held 4.260s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:29 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Created reservations ['56e26602-890d-4cd9-b183-474cc64cc8fd', '5bca8617-a34f-41bb-b7c0-74ff6bcd0246', '2e75b66b-da4d-46fd-9335-3d39486875a6', '5d24d9a7-96a3-4e69-b11a-44280aa9ffd9'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Delete snapshot completed successfully. Jun 23 13:59:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1e272303-5385-43cd-b94e-2d0c366f58cf tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-e54c4a8d-8cd1-4a4c-885d-31dba9a9e1d8-delete_snapshot" released by "delete_snapshot" :: held 4.441s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Creating offline snapshot d852c2f8-0325-4a7a-9a49-77a8111d4837 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:59:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[77342274-181e-4dcc-be79-92f09c460ca3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:30 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:30 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:31 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 1.000s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:31 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 1G Jun 23 13:59:31 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:33 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 1G" returned: 0 in 1.566s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:33 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 Jun 23 13:59:33 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:34 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837" returned: 0 in 0.919s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:34 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 is being set with open permissions: ugo+rw Jun 23 13:59:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:34 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 Jun 23 13:59:34 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:35 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837" returned: 0 in 1.046s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.686s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-17677951-45f0-4673-8bcc-41bf018cbed2 tempest-SnapshotsActionsTest-1605228398 None] Create snapshot completed successfully Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-d852c2f8-0325-4a7a-9a49-77a8111d4837-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-d852c2f8-0325-4a7a-9a49-77a8111d4837-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Acquiring lock "cinder-quobyte-d852c2f8-0325-4a7a-9a49-77a8111d4837" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-d852c2f8-0325-4a7a-9a49-77a8111d4837" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Deleting offline snapshot d852c2f8-0325-4a7a-9a49-77a8111d4837 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] snapshot_file for this snap is: volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7cd3f4-7015-4a6e-a019-16d57ecfa313]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:36 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 Jun 23 13:59:36 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:37 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837" returned: 0 in 0.948s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f44f6f-bf8e-4534-9527-34b4d9781e35]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:37 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:37 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:38 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 0.905s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:38 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 Jun 23 13:59:38 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:39 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837" returned: 0 in 1.012s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:39 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837 Jun 23 13:59:39 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-124cc86f-6acc-497e-9930-00b32d848449 req-828af69c-1b64-461b-bc77-e748bd90e38b tempest-AttachVolumeTestJSON-1522754590 None] Terminate volume connection completed successfully. Jun 23 13:59:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-124cc86f-6acc-497e-9930-00b32d848449 req-828af69c-1b64-461b-bc77-e748bd90e38b tempest-AttachVolumeTestJSON-1522754590 None] Deleting attachment 1b533c3d-88a1-46d1-99f1-83c337c37414. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:59:39 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.d852c2f8-0325-4a7a-9a49-77a8111d4837" returned: 0 in 0.794s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-d852c2f8-0325-4a7a-9a49-77a8111d4837" released by "_delete_snapshot" :: held 3.805s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" released by "delete_snapshot" :: held 3.842s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:40 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Created reservations ['486e2cd8-8be5-4cd2-ad40-5e9a92865630', 'e8cac386-6971-4d80-8ad4-adca1aff40cb', '4bb9db32-cede-4703-a2b3-4d7f5a98cd83', '129aa823-32a8-4ced-b9ad-5890491e7831'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Delete snapshot completed successfully. Jun 23 13:59:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7564caa6-848c-4333-b833-3abf71bdd686 tempest-SnapshotsActionsTest-253818796 None] Lock "cinder-d852c2f8-0325-4a7a-9a49-77a8111d4837-delete_snapshot" released by "delete_snapshot" :: held 4.051s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "cinder-bc4bc329-d146-4230-8515-2565e62d07b9-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-bc4bc329-d146-4230-8515-2565e62d07b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "cinder-quobyte-bc4bc329-d146-4230-8515-2565e62d07b9" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-quobyte-bc4bc329-d146-4230-8515-2565e62d07b9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Deleting offline snapshot bc4bc329-d146-4230-8515-2565e62d07b9 of volume 109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] snapshot_file for this snap is: volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3712fff0-bdc3-4eab-a344-063ce0c78d69]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:41 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:41 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:42 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 1.089s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109a7c74-58f0-4c66-9e55-faa476f7dd68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:59:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a629e-910e-43ca-a06b-482c2f472dbd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:42 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 Jun 23 13:59:42 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-30aaf2d1-011f-4ba9-81dd-b817e1b91f38 req-a43bc0ff-59e2-4d20-ac40-c89df52ce864 tempest-AttachVolumeNegativeTest-1318192135 None] Terminate volume connection completed successfully. Jun 23 13:59:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-30aaf2d1-011f-4ba9-81dd-b817e1b91f38 req-a43bc0ff-59e2-4d20-ac40-c89df52ce864 tempest-AttachVolumeNegativeTest-1318192135 None] Deleting attachment a8d90989-d20b-470a-b39c-72fd305ae888. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:59:43 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68" returned: 0 in 1.676s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:43 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:43 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:45 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 1.118s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:45 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9 Jun 23 13:59:45 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:45 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68.bc4bc329-d146-4230-8515-2565e62d07b9" returned: 0 in 0.875s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-quobyte-bc4bc329-d146-4230-8515-2565e62d07b9" released by "_delete_snapshot" :: held 4.982s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" released by "delete_snapshot" :: held 5.015s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Created reservations ['8700493e-7ba3-421d-a715-fbb5ff9ba865', '240665bc-971b-4bef-ae24-a32091117fb9', '9cb82203-4485-470d-b869-ac5a66c385ac', '382f397c-f5e5-40b0-a16e-172eaf0059a8'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Delete snapshot completed successfully. Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a645ecd9-5c5e-41b4-a004-1cb329c3d10f tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-bc4bc329-d146-4230-8515-2565e62d07b9-delete_snapshot" released by "delete_snapshot" :: held 5.204s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "cinder-109a7c74-58f0-4c66-9e55-faa476f7dd68-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-109a7c74-58f0-4c66-9e55-faa476f7dd68-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" acquired by "delete_volume" :: waited 0.095s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b11b8a-4e4d-4595-8bad-09127af5b8fc]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:47 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 Jun 23 13:59:47 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:48 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68" returned: 0 in 1.285s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:48 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68 Jun 23 13:59:48 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:49 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-109a7c74-58f0-4c66-9e55-faa476f7dd68" returned: 0 in 1.021s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-quobyte-109a7c74-58f0-4c66-9e55-faa476f7dd68" released by "delete_volume" :: held 2.490s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Created reservations ['414df96a-aba4-44bf-b1cb-5fda464c3e2f', '8277627d-4162-4827-930c-97fb9e1f9d18', '3813c699-8d00-47b2-badc-e6f6c9cf16a3', 'b05d1198-878d-4a63-a4bd-7dce43f34f6b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:49 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:59:49 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:50 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.879s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:50 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Deleted volume successfully. Jun 23 13:59:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ca1b861b-aa89-4951-95d3-8b22494a901c tempest-SnapshotsActionsTest-1605228398 None] Lock "cinder-109a7c74-58f0-4c66-9e55-faa476f7dd68-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:51 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:59:51 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:52 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.957s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:59:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:59:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:59:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:59:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Acquiring lock "cinder-edd36834-4360-41f2-816c-d430f435dd4d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "cinder-edd36834-4360-41f2-816c-d430f435dd4d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Acquiring lock "cinder-quobyte-edd36834-4360-41f2-816c-d430f435dd4d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:59:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "cinder-quobyte-edd36834-4360-41f2-816c-d430f435dd4d" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:59:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9668a8d-c531-4e00-a81d-edda4424d465]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:59:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:57 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d Jun 23 13:59:57 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:58 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d" returned: 0 in 1.361s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:58 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d Jun 23 13:59:58 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:59:59 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-edd36834-4360-41f2-816c-d430f435dd4d" returned: 0 in 1.161s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "cinder-quobyte-edd36834-4360-41f2-816c-d430f435dd4d" released by "delete_volume" :: held 2.649s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Created reservations ['0912b807-7934-47c8-af05-ac84a5de0cee', '4a20e1d4-72e3-45a7-83ac-ca6748f3d400', 'ac3fed88-2610-4f9f-9b38-6eed32a625be', '456a2fcb-b594-4de9-9e15-a5e8cb5407ac'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:59:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:59:59 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 13:59:59 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:01 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.482s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:01 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Deleted volume successfully. Jun 23 14:00:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a6297f91-884a-4f1d-b88b-2f0b96c051df tempest-AttachVolumeShelveTestJSON-803588905 None] Lock "cinder-edd36834-4360-41f2-816c-d430f435dd4d-delete_volume" released by "delete_volume" :: held 4.563s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Flow 'volume_create_manager' (c9676f2c-fe70-4b3b-a52f-120cda81f71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df90c89-49d1-451d-8b32-d11a4f584e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df90c89-49d1-451d-8b32-d11a4f584e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1915142151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba040a2-a571-4ae3-b4f6-4ee07b7c454c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8ce162b8f495d88b73e71e7c45dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:09Z,use_quota=True,user_id='9510ba72a87b466dab439b4c23ac9274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e56566c-177f-418c-ad0e-aa8ab6c2f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e56566c-177f-418c-ad0e-aa8ab6c2f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61efc105-f2c0-4058-bd95-795347657e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61efc105-f2c0-4058-bd95-795347657e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba040a2-a571-4ae3-b4f6-4ee07b7c454c', 'volume_name': 'volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb92707-9c0f-4314-8567-cadf544d83a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb92707-9c0f-4314-8567-cadf544d83a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06782d86-4f9d-4be3-9952-438c31473f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:08 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Volume 5ba040a2-a571-4ae3-b4f6-4ee07b7c454c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c', 'volume_size': 1} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1915142151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba040a2-a571-4ae3-b4f6-4ee07b7c454c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce8ce162b8f495d88b73e71e7c45dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:09Z,use_quota=True,user_id='9510ba72a87b466dab439b4c23ac9274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Creating volume 5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:08 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:08 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c 1073741824 Jun 23 14:00:08 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:10 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c 1073741824" returned: 0 in 1.734s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:10 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c Jun 23 14:00:10 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:11 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" returned: 0 in 1.020s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] <== create_volume: return (2901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.908s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06782d86-4f9d-4be3-9952-438c31473f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2ce3ef-a9b5-4d4b-a66b-c2b8e360bc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Volume volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c (5ba040a2-a571-4ae3-b4f6-4ee07b7c454c): created successfully Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf2ce3ef-a9b5-4d4b-a66b-c2b8e360bc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Flow 'volume_create_manager' (c9676f2c-fe70-4b3b-a52f-120cda81f71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a437bcd1-4cbf-4673-8cae-bdde34446f14 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Created volume successfully. Jun 23 14:00:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Creating offline snapshot 3609672e-4c31-4444-90e0-7e59663a0a36 of volume 5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:00:13 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9350b639-a242-4944-bbab-9755e44e79ea]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:13 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c Jun 23 14:00:13 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:13 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" returned: 0 in 0.933s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:14 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 1G Jun 23 14:00:14 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:15 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 1G" returned: 0 in 1.039s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:15 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 Jun 23 14:00:15 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:15 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36" returned: 0 in 0.905s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:15 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 is being set with open permissions: ugo+rw Jun 23 14:00:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:15 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 Jun 23 14:00:15 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:17 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36" returned: 0 in 1.318s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:17 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info Jun 23 14:00:17 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:18 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info" returned: 0 in 1.178s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:18 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info is being set with open permissions: ugo+rw Jun 23 14:00:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:18 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info Jun 23 14:00:18 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:19 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.info" returned: 0 in 1.096s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.656s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-44f4abcd-c4e1-4c8f-a45d-7a08baa00095 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Create snapshot completed successfully Jun 23 14:00:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aa7755e4-029f-4a73-ad00-8e990d3327f8 tempest-BackendsCapabilitiesAdminTestsJSON-2146682047 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93605) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 14:00:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-08235411-84bd-4c72-9d52-67fed624abe0 tempest-BackendsCapabilitiesAdminTestsJSON-2146682047 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732494354248, 'free_capacity_gb': 1775.732494354248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93605) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "cinder-3609672e-4c31-4444-90e0-7e59663a0a36-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-3609672e-4c31-4444-90e0-7e59663a0a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "cinder-quobyte-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-quobyte-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "cinder-quobyte-3609672e-4c31-4444-90e0-7e59663a0a36" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-quobyte-3609672e-4c31-4444-90e0-7e59663a0a36" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Deleting offline snapshot 3609672e-4c31-4444-90e0-7e59663a0a36 of volume 5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] snapshot_file for this snap is: volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86d9087-ae2e-49ed-bd13-7f3ed9ee2dc8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:21 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 Jun 23 14:00:21 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:23 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36" returned: 0 in 1.924s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:00:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b257b7-4745-43ea-9fc4-a7dfbcf696ca]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:23 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c Jun 23 14:00:23 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:24 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" returned: 0 in 1.058s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:24 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 Jun 23 14:00:24 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:26 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36" returned: 0 in 1.573s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:26 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36 Jun 23 14:00:26 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:27 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c.3609672e-4c31-4444-90e0-7e59663a0a36" returned: 0 in 1.000s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=40,cinder:UPDATE=38,cinder:DELETE=1,cinder:INSERT=11 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=33,cinder:INSERT=11,cinder:UPDATE=40,cinder:DELETE=5 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-quobyte-3609672e-4c31-4444-90e0-7e59663a0a36" released by "_delete_snapshot" :: held 5.813s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-quobyte-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" released by "delete_snapshot" :: held 5.860s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Created reservations ['3d070840-5977-4a23-8810-eda6435e671a', '613099f4-a96a-499f-bfab-ebb3bde776a1', '34a4a7fd-0ff9-47d4-bf2c-99c71c4d04a4', 'c792da25-e2cd-4c8f-bbfe-8cbae7ed57f3'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Delete snapshot completed successfully. Jun 23 14:00:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d5658a5a-8208-4982-9810-8754457e6909 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-3609672e-4c31-4444-90e0-7e59663a0a36-delete_snapshot" released by "delete_snapshot" :: held 6.119s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "cinder-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "cinder-quobyte-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-quobyte-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:28 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed1bf6b-d5a0-485d-b5a7-c378972dfad7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:28 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c Jun 23 14:00:28 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:29 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" returned: 0 in 1.169s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:29 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c Jun 23 14:00:29 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:30 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" returned: 0 in 0.771s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-quobyte-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c" released by "delete_volume" :: held 2.059s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-90018c2d-9762-45cf-9a48-212389f133a3 tempest-GroupsTest-1368894735 None] Group tempest-Group1-1693383159: creating Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Created reservations ['f4c3553f-bbe0-42a1-8b02-4ba58740a54a', 'f4c93b0e-02d8-492c-9778-16a74a711a98', 'f2e6d701-4ad5-4528-a324-bafe0cd0c32c', 'c5156560-1798-49b8-95a6-96130ee4937b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-90018c2d-9762-45cf-9a48-212389f133a3 tempest-GroupsTest-1368894735 None] Group tempest-Group1-1693383159: created successfully Jun 23 14:00:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-90018c2d-9762-45cf-9a48-212389f133a3 tempest-GroupsTest-1368894735 None] Create group completed successfully. Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:30 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:00:30 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:31 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.871s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:31 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Deleted volume successfully. Jun 23 14:00:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a103a800-9e27-4cdc-a42e-dde18874fb22 tempest-VolumeSnapshotQuotasNegativeTestJSON-1914895300 None] Lock "cinder-5ba040a2-a571-4ae3-b4f6-4ee07b7c454c-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a2be7e7d-d217-4fe5-ab5b-16a922fcb4f7 tempest-GroupsTest-1368894735 None] Group tempest-Group2-908642505: creating Jun 23 14:00:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a2be7e7d-d217-4fe5-ab5b-16a922fcb4f7 tempest-GroupsTest-1368894735 None] Group tempest-Group2-908642505: created successfully Jun 23 14:00:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a2be7e7d-d217-4fe5-ab5b-16a922fcb4f7 tempest-GroupsTest-1368894735 None] Create group completed successfully. Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Flow 'volume_create_manager' (418b5064-ec1f-4745-90d1-3e950e0f2f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ef93bf-d82f-44dd-b41e-5d7caa7c1b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ef93bf-d82f-44dd-b41e-5d7caa7c1b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987572285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c4d4f47-f0b5-4e2e-8a14-05b870b5197f,host='devstack@QuobyteHD#QuobyteHD',id=4d6b9a2f-9733-491a-89bc-102d5d564339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c34a2309aa94c9bb04c1611cf054121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:33Z,use_quota=True,user_id='3694a75c0e1e495cb6daee84a26bddde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96ec355d-b35c-408d-b4e5-a8c074f326ef),volume_type_id=96ec355d-b35c-408d-b4e5-a8c074f326ef)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374fac0f-dd6c-4249-a155-63b2f8d48c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374fac0f-dd6c-4249-a155-63b2f8d48c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30842b01-dcce-44e9-99d5-2c0af127903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30842b01-dcce-44e9-99d5-2c0af127903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6b9a2f-9733-491a-89bc-102d5d564339', 'volume_name': 'volume-4d6b9a2f-9733-491a-89bc-102d5d564339', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf2a97b-7322-47f0-9b16-8e6eae9f6962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf2a97b-7322-47f0-9b16-8e6eae9f6962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a27bab7-d72c-48fc-95cc-eb10868889b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:33 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Volume 4d6b9a2f-9733-491a-89bc-102d5d564339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6b9a2f-9733-491a-89bc-102d5d564339', 'volume_size': 1} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9c4d4f47-f0b5-4e2e-8a14-05b870b5197f,created_at=2026-06-23T12:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987572285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9c4d4f47-f0b5-4e2e-8a14-05b870b5197f,host='devstack@QuobyteHD#QuobyteHD',id=4d6b9a2f-9733-491a-89bc-102d5d564339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c34a2309aa94c9bb04c1611cf054121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:33Z,use_quota=True,user_id='3694a75c0e1e495cb6daee84a26bddde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96ec355d-b35c-408d-b4e5-a8c074f326ef),volume_type_id=96ec355d-b35c-408d-b4e5-a8c074f326ef)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Creating volume 4d6b9a2f-9733-491a-89bc-102d5d564339 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:33 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:33 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 1073741824 Jun 23 14:00:33 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:34 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 1073741824" returned: 0 in 1.207s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:34 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 Jun 23 14:00:34 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:35 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339" returned: 0 in 0.851s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a27bab7-d72c-48fc-95cc-eb10868889b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6b9a2f-9733-491a-89bc-102d5d564339', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf2c21a-d2b1-42df-8e99-afa73f4397fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Volume volume-4d6b9a2f-9733-491a-89bc-102d5d564339 (4d6b9a2f-9733-491a-89bc-102d5d564339): created successfully Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf2c21a-d2b1-42df-8e99-afa73f4397fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Flow 'volume_create_manager' (418b5064-ec1f-4745-90d1-3e950e0f2f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0735e3ab-32b2-4306-869c-81d860f1d8ac tempest-GroupsTest-1368894735 None] Created volume successfully. Jun 23 14:00:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Acquiring lock "cinder-quobyte-4d6b9a2f-9733-491a-89bc-102d5d564339" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Lock "cinder-quobyte-4d6b9a2f-9733-491a-89bc-102d5d564339" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ae091-2672-4c98-a8de-db2f4f799704]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:37 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 Jun 23 14:00:37 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:38 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339" returned: 0 in 1.181s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:38 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339 Jun 23 14:00:38 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:39 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4d6b9a2f-9733-491a-89bc-102d5d564339" returned: 0 in 1.019s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Lock "cinder-quobyte-4d6b9a2f-9733-491a-89bc-102d5d564339" released by "delete_volume" :: held 2.266s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Created reservations ['adc3fb3b-0a30-4ee4-a27a-be2b5dac2bf1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:39 devstack cinder-volume[93605]: WARNING cinder.quota [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-736092075 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-736092075, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:00:39 devstack cinder-volume[93605]: WARNING cinder.quota [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-736092075 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-736092075, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Created reservations ['c6f0f3f3-62d0-4108-9235-313edd7d849e', 'fe00de3b-a3dd-44d5-a716-8f31e9542ce1', '32adfbbe-6792-499b-9389-21169d044e0f', 'b408d897-d1da-4fde-8fd0-8c190f96c109'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:39 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:00:39 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:40 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.823s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ed8ccc4f-32ad-4a0d-a9b0-75112fb523bc tempest-GroupsTest-1368894735 None] Delete group completed successfully. Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Created reservations ['44738a7e-46b8-4f02-8417-f05dc8285f2f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:40 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:00:40 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:41 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.023s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:41 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-468f3a9f-6db3-45bb-b952-89b7a8b7fc84 tempest-GroupsTest-1368894735 None] Delete group completed successfully. Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Flow 'volume_create_manager' (e2d7c73a-8c8a-4692-b89c-95f466ba363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18a99c7-b183-4df6-85f2-9356a206c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fef9b744-a25b-4594-a69f-c7ec11cecca0 tempest-GroupsTest-1368894735 None] Group tempest-GroupsTest-Group-1477165233: creating Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18a99c7-b183-4df6-85f2-9356a206c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-453294353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c837388-f5e5-466e-a2e6-455d6050fc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdda29a849464f84c0ae172a3a0e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:43Z,use_quota=True,user_id='fd3220a032f74cee814b047eff00c9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bddee6-5ef6-4c2a-b9e4-2ad826cc5e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bddee6-5ef6-4c2a-b9e4-2ad826cc5e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e0cf41-261e-4396-9908-7687a1040340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e0cf41-261e-4396-9908-7687a1040340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c837388-f5e5-466e-a2e6-455d6050fc26', 'volume_name': 'volume-4c837388-f5e5-466e-a2e6-455d6050fc26', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db681725-c8b4-4299-b3b2-9c0b3ac6d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db681725-c8b4-4299-b3b2-9c0b3ac6d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54864859-a129-4698-909c-5d72b1ee46a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Volume 4c837388-f5e5-466e-a2e6-455d6050fc26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c837388-f5e5-466e-a2e6-455d6050fc26', 'volume_size': 1} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-453294353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c837388-f5e5-466e-a2e6-455d6050fc26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdda29a849464f84c0ae172a3a0e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:43Z,use_quota=True,user_id='fd3220a032f74cee814b047eff00c9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Creating volume 4c837388-f5e5-466e-a2e6-455d6050fc26 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:43 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:43 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 1073741824 Jun 23 14:00:43 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fef9b744-a25b-4594-a69f-c7ec11cecca0 tempest-GroupsTest-1368894735 None] Group tempest-GroupsTest-Group-1477165233: created successfully Jun 23 14:00:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fef9b744-a25b-4594-a69f-c7ec11cecca0 tempest-GroupsTest-1368894735 None] Create group completed successfully. Jun 23 14:00:44 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 1073741824" returned: 0 in 1.490s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:44 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 Jun 23 14:00:44 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Flow 'volume_create_manager' (90c48c37-50e5-435b-a875-8e527a066d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421cbd8b-6cb9-4e43-bfc8-af6ab8a8a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421cbd8b-6cb9-4e43-bfc8-af6ab8a8a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745938869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7deac90b-d46e-4510-ac9b-1b14f533090a,host='devstack@QuobyteHD#QuobyteHD',id=ef7ae173-5bd0-4868-8281-1f81e7e8e5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c34a2309aa94c9bb04c1611cf054121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:45Z,use_quota=True,user_id='3694a75c0e1e495cb6daee84a26bddde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce162771-e44d-432d-99df-ec00776cfd69),volume_type_id=ce162771-e44d-432d-99df-ec00776cfd69)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a972fcef-b531-4b43-b5fe-1bc08e76414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a972fcef-b531-4b43-b5fe-1bc08e76414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207740c9-faa9-4af7-a731-08072f0b93fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207740c9-faa9-4af7-a731-08072f0b93fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7ae173-5bd0-4868-8281-1f81e7e8e5a2', 'volume_name': 'volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d76c66-10b9-4b1a-9575-f978c2c32fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d76c66-10b9-4b1a-9575-f978c2c32fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2f744a-a518-4727-a794-64b99da9f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:45 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Volume ef7ae173-5bd0-4868-8281-1f81e7e8e5a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2', 'volume_size': 1} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:45 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26" returned: 0 in 0.885s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7deac90b-d46e-4510-ac9b-1b14f533090a,created_at=2026-06-23T12:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745938869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7deac90b-d46e-4510-ac9b-1b14f533090a,host='devstack@QuobyteHD#QuobyteHD',id=ef7ae173-5bd0-4868-8281-1f81e7e8e5a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c34a2309aa94c9bb04c1611cf054121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:45Z,use_quota=True,user_id='3694a75c0e1e495cb6daee84a26bddde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce162771-e44d-432d-99df-ec00776cfd69),volume_type_id=ce162771-e44d-432d-99df-ec00776cfd69)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Creating volume ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:45 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54864859-a129-4698-909c-5d72b1ee46a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c837388-f5e5-466e-a2e6-455d6050fc26', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e6917e-24f4-44fc-8d51-bb01704a8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:45 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 1073741824 Jun 23 14:00:45 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:45 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Volume volume-4c837388-f5e5-466e-a2e6-455d6050fc26 (4c837388-f5e5-466e-a2e6-455d6050fc26): created successfully Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e6917e-24f4-44fc-8d51-bb01704a8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Flow 'volume_create_manager' (e2d7c73a-8c8a-4692-b89c-95f466ba363b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:45 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4e9faff6-0bdb-4340-bcba-c147d488b181 tempest-AttachVolumeNegativeTest-1318192135 None] Created volume successfully. Jun 23 14:00:46 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 1073741824" returned: 0 in 1.230s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:46 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 Jun 23 14:00:46 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Flow 'volume_create_manager' (d4db0f90-3703-4b5e-bcef-ffb632843f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81223961-cc0f-4392-8c2a-9a1135768beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81223961-cc0f-4392-8c2a-9a1135768beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-61648453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bfcdc4-42ca-4897-97c6-274014cf3750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6cc6718aca4e44b3ce1c1fa8f36ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:47Z,use_quota=True,user_id='3f219ca1def14becb3d5c0d17cf9363d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76805a58-5bec-43be-95cf-8a42081408fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76805a58-5bec-43be-95cf-8a42081408fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ae254a-a3fc-49d3-9c21-e80b9d57aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ae254a-a3fc-49d3-9c21-e80b9d57aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95bfcdc4-42ca-4897-97c6-274014cf3750', 'volume_name': 'volume-95bfcdc4-42ca-4897-97c6-274014cf3750', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea00836a-5227-47c8-b12d-ad1671205738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea00836a-5227-47c8-b12d-ad1671205738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9e3fcf-9b39-472f-ab3c-da8a5a318f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:47 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Volume 95bfcdc4-42ca-4897-97c6-274014cf3750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95bfcdc4-42ca-4897-97c6-274014cf3750', 'volume_size': 1} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:47 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2" returned: 0 in 0.846s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-61648453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95bfcdc4-42ca-4897-97c6-274014cf3750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6cc6718aca4e44b3ce1c1fa8f36ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:47Z,use_quota=True,user_id='3f219ca1def14becb3d5c0d17cf9363d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Creating volume 95bfcdc4-42ca-4897-97c6-274014cf3750 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:47 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:47 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 1073741824 Jun 23 14:00:47 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2f744a-a518-4727-a794-64b99da9f355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b71deb-7c70-4247-9232-cc7b59d6d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:47 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Volume volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 (ef7ae173-5bd0-4868-8281-1f81e7e8e5a2): created successfully Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b71deb-7c70-4247-9232-cc7b59d6d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Flow 'volume_create_manager' (90c48c37-50e5-435b-a875-8e527a066d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-338544ea-d04f-4118-b7a5-7ef63ae49342 tempest-GroupsTest-1368894735 None] Created volume successfully. Jun 23 14:00:48 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 1073741824" returned: 0 in 1.067s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:48 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 Jun 23 14:00:48 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Flow 'volume_create_manager' (eb1dcb0e-81d3-4218-8602-39c18516fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf3cac3-308e-414f-a6a0-1ab2fdc98952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf3cac3-308e-414f-a6a0-1ab2fdc98952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1821064420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7deac90b-d46e-4510-ac9b-1b14f533090a,host='devstack@QuobyteHD#QuobyteHD',id=336fd4db-eb08-4778-b887-ca1c536d0a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c34a2309aa94c9bb04c1611cf054121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:49Z,use_quota=True,user_id='3694a75c0e1e495cb6daee84a26bddde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce162771-e44d-432d-99df-ec00776cfd69),volume_type_id=ce162771-e44d-432d-99df-ec00776cfd69)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b575fa12-fe09-4c8d-892f-42acaf5f3889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b575fa12-fe09-4c8d-892f-42acaf5f3889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a227255e-1889-4bc2-91f3-2dd8f29ce3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a227255e-1889-4bc2-91f3-2dd8f29ce3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336fd4db-eb08-4778-b887-ca1c536d0a35', 'volume_name': 'volume-336fd4db-eb08-4778-b887-ca1c536d0a35', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dc6525-edcb-479e-b0ca-00b54440ac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dc6525-edcb-479e-b0ca-00b54440ac4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6395d84-9cdb-4113-b2b6-e8236e64c81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:49 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Volume 336fd4db-eb08-4778-b887-ca1c536d0a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336fd4db-eb08-4778-b887-ca1c536d0a35', 'volume_size': 1} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:49 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750" returned: 0 in 0.808s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7deac90b-d46e-4510-ac9b-1b14f533090a,created_at=2026-06-23T12:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1821064420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7deac90b-d46e-4510-ac9b-1b14f533090a,host='devstack@QuobyteHD#QuobyteHD',id=336fd4db-eb08-4778-b887-ca1c536d0a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c34a2309aa94c9bb04c1611cf054121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:49Z,use_quota=True,user_id='3694a75c0e1e495cb6daee84a26bddde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce162771-e44d-432d-99df-ec00776cfd69),volume_type_id=ce162771-e44d-432d-99df-ec00776cfd69)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Creating volume 336fd4db-eb08-4778-b887-ca1c536d0a35 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:49 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:49 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 1073741824 Jun 23 14:00:49 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9e3fcf-9b39-472f-ab3c-da8a5a318f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95bfcdc4-42ca-4897-97c6-274014cf3750', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2654baf-182a-4808-9048-47712cf78985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:49 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Volume volume-95bfcdc4-42ca-4897-97c6-274014cf3750 (95bfcdc4-42ca-4897-97c6-274014cf3750): created successfully Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2654baf-182a-4808-9048-47712cf78985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Flow 'volume_create_manager' (d4db0f90-3703-4b5e-bcef-ffb632843f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-532b123a-4021-4617-944b-db19be59ac5b tempest-VolumesListAdminTestJSON-2136461164 None] Created volume successfully. Jun 23 14:00:51 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 1073741824" returned: 0 in 2.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:51 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:00:51 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:51 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 Jun 23 14:00:51 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Flow 'volume_create_manager' (51cb2850-b0cb-4658-abde-46816317e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b98bbec-441a-4e06-b7e4-69268372d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b98bbec-441a-4e06-b7e4-69268372d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-716151106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3b50af-2589-448a-9081-255c16b6e48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6cc6718aca4e44b3ce1c1fa8f36ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:52Z,use_quota=True,user_id='3f219ca1def14becb3d5c0d17cf9363d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed9885f-00e3-4b77-a315-8bf4a2fb0b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed9885f-00e3-4b77-a315-8bf4a2fb0b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2d39d5-659e-443b-8788-c749fce066d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2d39d5-659e-443b-8788-c749fce066d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3b50af-2589-448a-9081-255c16b6e48e', 'volume_name': 'volume-5e3b50af-2589-448a-9081-255c16b6e48e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2e6b5a-7de1-442e-8a76-d545a7d286ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2e6b5a-7de1-442e-8a76-d545a7d286ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f10262-7a5a-40a4-ad99-fe61979032e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Volume 5e3b50af-2589-448a-9081-255c16b6e48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3b50af-2589-448a-9081-255c16b6e48e', 'volume_size': 1} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:52 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.011s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:00:52 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35" returned: 0 in 1.093s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] <== create_volume: return (3202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.205s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.269s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6395d84-9cdb-4113-b2b6-e8236e64c81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336fd4db-eb08-4778-b887-ca1c536d0a35', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ba95f1-c6e0-4268-949c-bf97a7ac53ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf38c2ed-4d2a-4ee8-bdeb-ff4030758d05]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:52 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Volume volume-336fd4db-eb08-4778-b887-ca1c536d0a35 (336fd4db-eb08-4778-b887-ca1c536d0a35): created successfully Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ba95f1-c6e0-4268-949c-bf97a7ac53ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Flow 'volume_create_manager' (eb1dcb0e-81d3-4218-8602-39c18516fff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9d84e7dc-7db7-48d7-8adb-38506062e3ca tempest-GroupsTest-1368894735 None] Created volume successfully. Jun 23 14:00:53 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 Jun 23 14:00:53 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-3c96c962-1539-4c44-8be6-e7489f1d5fe3 tempest-GroupsTest-1368894735 None] Update group completed successfully. Jun 23 14:00:54 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26" returned: 0 in 1.168s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.217s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-716151106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3b50af-2589-448a-9081-255c16b6e48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6cc6718aca4e44b3ce1c1fa8f36ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:52Z,use_quota=True,user_id='3f219ca1def14becb3d5c0d17cf9363d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Creating volume 5e3b50af-2589-448a-9081-255c16b6e48e {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:54 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:54 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e 1073741824 Jun 23 14:00:54 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-4c837388-f5e5-466e-a2e6-455d6050fc26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79ed9d81-5e2b-4810-a1ff-26c8d442b866', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:00:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-13c22c64-310e-44fe-88ea-90cef4dc32d0 req-99dcea27-24f1-42a9-81cc-016c23031598 tempest-AttachVolumeNegativeTest-1318192135 None] attachment_update completed successfully. Jun 23 14:00:55 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5bce0ac1-4b2d-44c8-a732-8873d59a51f7 tempest-GroupsTest-1368894735 None] Update group completed successfully. Jun 23 14:00:55 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e 1073741824" returned: 0 in 1.377s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:55 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e Jun 23 14:00:55 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:56 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e" returned: 0 in 1.072s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] <== create_volume: return (2526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.529s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f10262-7a5a-40a4-ad99-fe61979032e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3b50af-2589-448a-9081-255c16b6e48e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb63fed-6c2f-4498-8956-4e5dc8ff9246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Volume volume-5e3b50af-2589-448a-9081-255c16b6e48e (5e3b50af-2589-448a-9081-255c16b6e48e): created successfully Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb63fed-6c2f-4498-8956-4e5dc8ff9246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Flow 'volume_create_manager' (51cb2850-b0cb-4658-abde-46816317e809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:56 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f9471066-0e51-414d-b67e-756ce93b5851 tempest-VolumesListAdminTestJSON-2136461164 None] Created volume successfully. Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Acquiring lock "cinder-quobyte-336fd4db-eb08-4778-b887-ca1c536d0a35" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Lock "cinder-quobyte-336fd4db-eb08-4778-b887-ca1c536d0a35" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea52614-f335-44f7-9951-84ab5535efc2]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:57 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 Jun 23 14:00:57 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Flow 'volume_create_manager' (1e35b759-aad9-49fb-ad24-169eeb401e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7c739d-b83b-4d18-8dd0-1913c63160b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7c739d-b83b-4d18-8dd0-1913c63160b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2012046377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c88d01a-c12c-448c-8bf2-aa65767834e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6cc6718aca4e44b3ce1c1fa8f36ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:58Z,use_quota=True,user_id='3f219ca1def14becb3d5c0d17cf9363d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008446cb-17c5-47e6-bc79-6aa86227b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008446cb-17c5-47e6-bc79-6aa86227b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edbc52f-c371-430c-8114-6ef6f5ee3e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edbc52f-c371-430c-8114-6ef6f5ee3e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c88d01a-c12c-448c-8bf2-aa65767834e8', 'volume_name': 'volume-2c88d01a-c12c-448c-8bf2-aa65767834e8', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690169ce-4498-4908-9342-a86b81411844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690169ce-4498-4908-9342-a86b81411844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f6d0ce-440a-4560-8e00-834d8eae1bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:00:57 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Volume 2c88d01a-c12c-448c-8bf2-aa65767834e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c88d01a-c12c-448c-8bf2-aa65767834e8', 'volume_size': 1} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2012046377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c88d01a-c12c-448c-8bf2-aa65767834e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b6cc6718aca4e44b3ce1c1fa8f36ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:00:58Z,use_quota=True,user_id='3f219ca1def14becb3d5c0d17cf9363d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Creating volume 2c88d01a-c12c-448c-8bf2-aa65767834e8 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:00:57 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:00:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:58 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 1073741824 Jun 23 14:00:58 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:58 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35" returned: 0 in 1.297s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:58 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35 Jun 23 14:00:58 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:59 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 1073741824" returned: 0 in 1.241s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:00:59 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 Jun 23 14:00:59 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:00:59 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-336fd4db-eb08-4778-b887-ca1c536d0a35" returned: 0 in 1.159s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Lock "cinder-quobyte-336fd4db-eb08-4778-b887-ca1c536d0a35" released by "delete_volume" :: held 2.549s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Acquiring lock "cinder-quobyte-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Lock "cinder-quobyte-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9ad09-2095-4c6a-837d-ca8de3a279fa]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:00:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:00 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 Jun 23 14:01:00 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:00 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8" returned: 0 in 1.019s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f6d0ce-440a-4560-8e00-834d8eae1bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c88d01a-c12c-448c-8bf2-aa65767834e8', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67196a7-188f-4c91-a57b-af832d5e3eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:00 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Volume volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 (2c88d01a-c12c-448c-8bf2-aa65767834e8): created successfully Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67196a7-188f-4c91-a57b-af832d5e3eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Flow 'volume_create_manager' (1e35b759-aad9-49fb-ad24-169eeb401e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:00 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-3be69034-ce4d-452a-a8fe-5b78647fa801 tempest-VolumesListAdminTestJSON-2136461164 None] Created volume successfully. Jun 23 14:01:00 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2" returned: 0 in 0.979s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:01 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2 Jun 23 14:01:01 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-fa5094aa-06f1-4c42-9be5-76c7c1acd2db req-148bf84c-ba13-4fd7-ba8c-18e05b89b7dc tempest-AttachVolumeNegativeTest-1318192135 None] Terminate volume connection completed successfully. Jun 23 14:01:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-fa5094aa-06f1-4c42-9be5-76c7c1acd2db req-148bf84c-ba13-4fd7-ba8c-18e05b89b7dc tempest-AttachVolumeNegativeTest-1318192135 None] Deleting attachment 79ed9d81-5e2b-4810-a1ff-26c8d442b866. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:01:01 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2" returned: 0 in 1.005s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Lock "cinder-quobyte-ef7ae173-5bd0-4868-8281-1f81e7e8e5a2" released by "delete_volume" :: held 2.076s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Created reservations ['f4b2d66d-1475-4728-8704-64eb7dc71716'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:02 devstack cinder-volume[93605]: WARNING cinder.quota [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1367007672 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1367007672, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:01:02 devstack cinder-volume[93605]: WARNING cinder.quota [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1367007672 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1367007672, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Created reservations ['64b4d231-a90f-4069-9357-19385fde54b2', 'f11982f0-aa2b-410d-9086-91a00c3e6a9e', '7be5263f-5bb8-43af-8ad5-9f6d4af9f1e2', 'c3cdb423-9339-4ba9-85af-9ebd0ed31711'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Created reservations ['a6a94fce-0073-44df-97bd-034960dc7b6a', '6cfc0bbe-5273-4d85-96f6-cc455c529afa', '13b2c1b9-cc8e-43a7-89cf-ebf3a99158c3', '90a27bbf-30ba-4941-8879-70703c35ca59'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Flow 'volume_create_manager' (8498d03e-5e25-4e46-ab38-f7e8e764417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece51b02-9610-4c78-8be9-fb4343d531c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece51b02-9610-4c78-8be9-fb4343d531c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fd04bd-9dae-4b01-9ae1-9e26393c5411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06a6e967bd44beb887bb2beaf05895f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:02Z,use_quota=True,user_id='741a5e0ee9a941d1a3495f23b9dc0c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ec7671-dbbd-454b-93c4-ce1865d86d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ec7671-dbbd-454b-93c4-ce1865d86d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37483c4f-9f82-4902-8615-53b89454965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37483c4f-9f82-4902-8615-53b89454965a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fd04bd-9dae-4b01-9ae1-9e26393c5411', 'volume_name': 'volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65467c7e-d30b-4080-ace8-1c2e9c48bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65467c7e-d30b-4080-ace8-1c2e9c48bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31528f2-25ac-41ef-9341-70567869ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:02 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Volume b9fd04bd-9dae-4b01-9ae1-9e26393c5411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411', 'volume_size': 1} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fd04bd-9dae-4b01-9ae1-9e26393c5411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a06a6e967bd44beb887bb2beaf05895f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:02Z,use_quota=True,user_id='741a5e0ee9a941d1a3495f23b9dc0c4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Creating volume b9fd04bd-9dae-4b01-9ae1-9e26393c5411 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:02 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:02 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 1073741824 Jun 23 14:01:02 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:02 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:02 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:03 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.956s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:03 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ff910752-b2d5-4a04-af0d-90fdc0fe4db4 tempest-GroupsTest-1368894735 None] Delete group completed successfully. Jun 23 14:01:04 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 1073741824" returned: 0 in 1.307s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:04 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 Jun 23 14:01:04 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:05 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411" returned: 0 in 1.050s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] <== create_volume: return (2427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.430s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31528f2-25ac-41ef-9341-70567869ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea087a2-2801-4a45-a316-aa6f0cefe532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:05 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Volume volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 (b9fd04bd-9dae-4b01-9ae1-9e26393c5411): created successfully Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea087a2-2801-4a45-a316-aa6f0cefe532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Flow 'volume_create_manager' (8498d03e-5e25-4e46-ab38-f7e8e764417f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-eb9d3ca4-304e-4eed-90c7-90e11380feb6 tempest-VolumesListAdminTestJSON-511022737 None] Created volume successfully. Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Acquiring lock "cinder-b9fd04bd-9dae-4b01-9ae1-9e26393c5411-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Lock "cinder-b9fd04bd-9dae-4b01-9ae1-9e26393c5411-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Acquiring lock "cinder-quobyte-b9fd04bd-9dae-4b01-9ae1-9e26393c5411" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Lock "cinder-quobyte-b9fd04bd-9dae-4b01-9ae1-9e26393c5411" acquired by "delete_volume" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a66c73-dc64-43b8-a614-ab1a43b93c1d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "cinder-2c88d01a-c12c-448c-8bf2-aa65767834e8-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-2c88d01a-c12c-448c-8bf2-aa65767834e8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "cinder-quobyte-2c88d01a-c12c-448c-8bf2-aa65767834e8" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-quobyte-2c88d01a-c12c-448c-8bf2-aa65767834e8" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[573382a1-f023-49e9-9560-efadaa90e8f6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:06 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 Jun 23 14:01:06 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:06 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 Jun 23 14:01:06 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:07 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411" returned: 0 in 1.383s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:07 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411 Jun 23 14:01:07 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8" returned: 0 in 1.389s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:07 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:07 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8 Jun 23 14:01:07 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:08 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9fd04bd-9dae-4b01-9ae1-9e26393c5411" returned: 0 in 1.004s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Lock "cinder-quobyte-b9fd04bd-9dae-4b01-9ae1-9e26393c5411" released by "delete_volume" :: held 2.450s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:08 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Created reservations ['5b7af479-260d-42d2-8c90-b0208b19fa0f', 'd29011b1-896a-4004-8643-31f68e2ee754', '2934e4a2-bc36-43cd-9019-d9279da1efc9', 'a7522a91-913f-49fc-a49e-240d6dbbfaca'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:08 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c88d01a-c12c-448c-8bf2-aa65767834e8" returned: 0 in 0.970s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-quobyte-2c88d01a-c12c-448c-8bf2-aa65767834e8" released by "delete_volume" :: held 2.435s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:09 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:09 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Created reservations ['09e9aacf-5ecd-4136-b5d0-9b13ae57e221', 'e56a13cf-7e31-4647-aca9-b1507e0266f8', 'd129971c-f460-4eb9-819a-d0714255b0c2', '7325fceb-3162-480c-a833-e174141f364f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:09 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:09 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:09 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Deleted volume successfully. Jun 23 14:01:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1ef26354-e5f2-4581-bef2-90c5557549db tempest-VolumesListAdminTestJSON-511022737 None] Lock "cinder-b9fd04bd-9dae-4b01-9ae1-9e26393c5411-delete_volume" released by "delete_volume" :: held 3.655s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:10 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "cinder-5e3b50af-2589-448a-9081-255c16b6e48e-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.916s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:10 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Deleted volume successfully. Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-5e3b50af-2589-448a-9081-255c16b6e48e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c742d2de-5886-4787-9e04-4f089254f43a tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-2c88d01a-c12c-448c-8bf2-aa65767834e8-delete_volume" released by "delete_volume" :: held 3.690s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "cinder-quobyte-5e3b50af-2589-448a-9081-255c16b6e48e" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-quobyte-5e3b50af-2589-448a-9081-255c16b6e48e" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb8ea6-abc0-40aa-905e-2f8ccc732512]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:10 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e Jun 23 14:01:10 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:11 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e" returned: 0 in 0.965s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:11 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e Jun 23 14:01:11 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:12 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e3b50af-2589-448a-9081-255c16b6e48e" returned: 0 in 0.823s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-quobyte-5e3b50af-2589-448a-9081-255c16b6e48e" released by "delete_volume" :: held 1.844s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Created reservations ['64cb41ae-5a0c-40b0-bf41-8aed10d98206', '0cb77107-7994-4acb-9834-c4cd2f2963f4', '2536c877-e1ec-41d4-bece-7a4a549baeb8', '1a41e7c9-fe4d-4054-8dd2-57fe6733e08f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-245e4086-015d-4a5d-a310-14de1e064bce tempest-GroupsV320Test-1704686912 None] Group tempest-GroupsV320Test-Group-1991241851: creating Jun 23 14:01:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-245e4086-015d-4a5d-a310-14de1e064bce tempest-GroupsV320Test-1704686912 None] Group tempest-GroupsV320Test-Group-1991241851: created successfully Jun 23 14:01:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-245e4086-015d-4a5d-a310-14de1e064bce tempest-GroupsV320Test-1704686912 None] Create group completed successfully. Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:12 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:12 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "cinder-95bfcdc4-42ca-4897-97c6-274014cf3750-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-95bfcdc4-42ca-4897-97c6-274014cf3750-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "cinder-quobyte-95bfcdc4-42ca-4897-97c6-274014cf3750" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-quobyte-95bfcdc4-42ca-4897-97c6-274014cf3750" acquired by "delete_volume" :: waited 0.040s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec33292-f5bc-44e2-9dc9-6677e6463a55]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:12 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 Jun 23 14:01:12 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:13 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.205s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:13 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:13 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Deleted volume successfully. Jun 23 14:01:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-702dd7a4-a7a5-49ff-8a9d-933b04a3139d tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-5e3b50af-2589-448a-9081-255c16b6e48e-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:14 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750" returned: 0 in 1.303s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:14 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750 Jun 23 14:01:14 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Created reservations ['5b5701d8-0440-4ea6-b5dd-db6f809d78ab'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:14 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:14 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:15 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-95bfcdc4-42ca-4897-97c6-274014cf3750" returned: 0 in 0.989s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-quobyte-95bfcdc4-42ca-4897-97c6-274014cf3750" released by "delete_volume" :: held 2.398s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Created reservations ['ad1aaa40-2ce7-4317-9b56-fde4b461c71e', '9ec778fa-f196-4640-a708-ca66dfbd9e56', '68efa20a-ce14-42dc-a060-3091724b8b52', '716029e1-7b0b-4da3-8bdc-e5267ee3c6f3'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:15 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.992s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-57365b36-3cc0-436a-a9c7-aec187a0ca0f tempest-GroupsV320Test-1704686912 None] Delete group completed successfully. Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:15 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:15 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:16 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.919s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:16 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Deleted volume successfully. Jun 23 14:01:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81d763cb-9e44-4483-b511-9851390e3414 tempest-VolumesListAdminTestJSON-2136461164 None] Lock "cinder-95bfcdc4-42ca-4897-97c6-274014cf3750-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Flow 'volume_create_manager' (db9741c6-f41c-4f52-8c32-376b1f4782c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1afa314-b52d-41a1-8584-48ca4d220eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1afa314-b52d-41a1-8584-48ca4d220eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-353946981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd76edc-e8cc-4692-b1c2-1b97d7702d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ae67e1883429493e2ba441064076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:17Z,use_quota=True,user_id='b3444a4bfff044b9a61421cb68ef4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7dc9e6-945d-48b0-a749-c5e7259c4075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7dc9e6-945d-48b0-a749-c5e7259c4075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cda1f65-ebbb-4df0-8b42-dcb432a5c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cda1f65-ebbb-4df0-8b42-dcb432a5c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd76edc-e8cc-4692-b1c2-1b97d7702d7d', 'volume_name': 'volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961eea0a-54e9-4a12-8201-6c7ce0714f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961eea0a-54e9-4a12-8201-6c7ce0714f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b07e2ea-ca9f-40d8-9e41-3c1b564bd1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Volume 4dd76edc-e8cc-4692-b1c2-1b97d7702d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d', 'volume_size': 1} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-353946981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd76edc-e8cc-4692-b1c2-1b97d7702d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ae67e1883429493e2ba441064076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:17Z,use_quota=True,user_id='b3444a4bfff044b9a61421cb68ef4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Creating volume 4dd76edc-e8cc-4692-b1c2-1b97d7702d7d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:17 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:17 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d 1073741824 Jun 23 14:01:17 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:18 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d 1073741824" returned: 0 in 1.215s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:18 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d Jun 23 14:01:18 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:19 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" returned: 0 in 1.241s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] <== create_volume: return (2535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b07e2ea-ca9f-40d8-9e41-3c1b564bd1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fa7256-24bf-43e6-9e6d-7d4cf67f749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:19 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Volume volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d (4dd76edc-e8cc-4692-b1c2-1b97d7702d7d): created successfully Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fa7256-24bf-43e6-9e6d-7d4cf67f749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Flow 'volume_create_manager' (db9741c6-f41c-4f52-8c32-376b1f4782c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-99c16735-f73e-447c-ba7a-460405d01b6c tempest-AttachVolumeTestJSON-1522754590 None] Created volume successfully. Jun 23 14:01:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea87a23-53a1-407c-a9af-0cbab7c12b03]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:23 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d Jun 23 14:01:23 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Flow 'volume_create_manager' (b73a8b84-6bb5-4b1e-a836-b20be374e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b373cb99-3021-45a4-8759-22dbab50fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b373cb99-3021-45a4-8759-22dbab50fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-247904480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83eea47-1af7-4f6b-ac8d-234608ba53c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eedbfc2adab4a33b7f9650aa1e7d545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:24Z,use_quota=True,user_id='fad665128f464597846f060e79d6258b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a592ec-79dc-48d8-9057-34333073b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a592ec-79dc-48d8-9057-34333073b564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ff9de-4364-4650-8921-2a8477b59ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5ff9de-4364-4650-8921-2a8477b59ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83eea47-1af7-4f6b-ac8d-234608ba53c8', 'volume_name': 'volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3207e163-b50f-4ce8-acf5-b93ad878f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3207e163-b50f-4ce8-acf5-b93ad878f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af406ec-404c-4f15-b12c-f638c0f38611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:24 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Volume a83eea47-1af7-4f6b-ac8d-234608ba53c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8', 'volume_size': 1} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:24 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" returned: 0 in 1.290s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.325s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-247904480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83eea47-1af7-4f6b-ac8d-234608ba53c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eedbfc2adab4a33b7f9650aa1e7d545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:24Z,use_quota=True,user_id='fad665128f464597846f060e79d6258b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Creating volume a83eea47-1af7-4f6b-ac8d-234608ba53c8 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:25 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:25 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 1073741824 Jun 23 14:01:25 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b71f747-0078-4436-bc11-da8242b405d9', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:01:25 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-f1f53975-41d2-48b7-98aa-0c79b0927900 req-23b9882a-34de-4d33-855b-a5c1e2b8cd31 tempest-AttachVolumeTestJSON-1522754590 None] attachment_update completed successfully. Jun 23 14:01:26 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 1073741824" returned: 0 in 1.503s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:26 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 Jun 23 14:01:26 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:27 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8" returned: 0 in 1.092s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] <== create_volume: return (2691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.698s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=93,cinder:INSERT=24,cinder:UPDATE=112,cinder:DELETE=9 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af406ec-404c-4f15-b12c-f638c0f38611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3c29f9-7952-4339-b66a-10717440401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=113,cinder:INSERT=26,cinder:UPDATE=124,cinder:DELETE=5 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:01:27 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Volume volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 (a83eea47-1af7-4f6b-ac8d-234608ba53c8): created successfully Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3c29f9-7952-4339-b66a-10717440401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Flow 'volume_create_manager' (b73a8b84-6bb5-4b1e-a836-b20be374e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f2fe3952-d42e-47c6-a81c-6b1ebcd7d7e3 tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Created volume successfully. Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Flow 'volume_create_manager' (01f03b95-0dd4-42ef-a649-11470e70ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6262cd7c-14f7-4f5f-8af2-2ca596bde24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6262cd7c-14f7-4f5f-8af2-2ca596bde24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1788283065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bde092d-238f-4e6f-9716-b840a3300873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e967ae20d4485e916f0634f4d53d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:29Z,use_quota=True,user_id='611f8a3d127a4c02badfcfc9cf2722e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d122dc1b-26e5-4e18-9e31-9342e4253f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d122dc1b-26e5-4e18-9e31-9342e4253f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47b231b-35fb-423e-9a09-bd5e445d480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47b231b-35fb-423e-9a09-bd5e445d480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bde092d-238f-4e6f-9716-b840a3300873', 'volume_name': 'volume-2bde092d-238f-4e6f-9716-b840a3300873', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fa6e0b-032c-4d8f-9c8a-7e10cc75c122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fa6e0b-032c-4d8f-9c8a-7e10cc75c122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f801f5-02d6-4a4d-af17-af6650baa110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:29 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Volume 2bde092d-238f-4e6f-9716-b840a3300873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bde092d-238f-4e6f-9716-b840a3300873', 'volume_size': 1} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1788283065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bde092d-238f-4e6f-9716-b840a3300873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e967ae20d4485e916f0634f4d53d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:29Z,use_quota=True,user_id='611f8a3d127a4c02badfcfc9cf2722e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Creating volume 2bde092d-238f-4e6f-9716-b840a3300873 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:29 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:29 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 1073741824 Jun 23 14:01:29 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Acquiring lock "cinder-a83eea47-1af7-4f6b-ac8d-234608ba53c8-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "cinder-a83eea47-1af7-4f6b-ac8d-234608ba53c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Acquiring lock "cinder-quobyte-a83eea47-1af7-4f6b-ac8d-234608ba53c8" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "cinder-quobyte-a83eea47-1af7-4f6b-ac8d-234608ba53c8" acquired by "delete_volume" :: waited 0.051s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c834670-a021-4222-af6d-a0529c78c6c3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:30 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 Jun 23 14:01:30 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:30 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 1073741824" returned: 0 in 1.252s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:30 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 Jun 23 14:01:30 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:30 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8" returned: 0 in 0.979s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:31 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8 Jun 23 14:01:31 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:31 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873" returned: 0 in 0.920s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f801f5-02d6-4a4d-af17-af6650baa110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bde092d-238f-4e6f-9716-b840a3300873', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e256c2c4-9092-442f-9700-b34f29037806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Volume volume-2bde092d-238f-4e6f-9716-b840a3300873 (2bde092d-238f-4e6f-9716-b840a3300873): created successfully Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e256c2c4-9092-442f-9700-b34f29037806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Flow 'volume_create_manager' (01f03b95-0dd4-42ef-a649-11470e70ae22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-072016b9-e878-4987-b953-25a9eaf1067d tempest-VolumesTransfersTest-732496748 None] Created volume successfully. Jun 23 14:01:31 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a83eea47-1af7-4f6b-ac8d-234608ba53c8" returned: 0 in 0.815s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "cinder-quobyte-a83eea47-1af7-4f6b-ac8d-234608ba53c8" released by "delete_volume" :: held 1.886s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Created reservations ['d0f7845f-48bd-48d9-a2fa-baa9881b51f3', '800071ed-a6fe-4ab3-b41c-76b866351135', 'e9ae238b-9d25-4a90-be8a-752d172e3eb3', 'b0bc7fde-2638-431c-b06d-ab14ba9ca4bc'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:32 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:32 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Flow 'volume_create_manager' (c3b59577-7efb-43d1-8d7c-c0fedffaec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31f5098-742e-423b-901a-338fb2a49672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31f5098-742e-423b-901a-338fb2a49672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1268330899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d99900-b813-4c23-a4e8-595f1054e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ae67e1883429493e2ba441064076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:32Z,use_quota=True,user_id='b3444a4bfff044b9a61421cb68ef4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e21b84-5ba0-49cf-9bf2-217e1c4b0187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e21b84-5ba0-49cf-9bf2-217e1c4b0187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa2724-f1f9-42eb-b9c8-0412db409fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa2724-f1f9-42eb-b9c8-0412db409fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d99900-b813-4c23-a4e8-595f1054e515', 'volume_name': 'volume-b7d99900-b813-4c23-a4e8-595f1054e515', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d360a512-d43f-49ab-8246-65eb8fba3130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d360a512-d43f-49ab-8246-65eb8fba3130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666e6fbe-a086-48dc-8d1d-fc5537391b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:32 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Volume b7d99900-b813-4c23-a4e8-595f1054e515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d99900-b813-4c23-a4e8-595f1054e515', 'volume_size': 1} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1268330899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d99900-b813-4c23-a4e8-595f1054e515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='959ae67e1883429493e2ba441064076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:32Z,use_quota=True,user_id='b3444a4bfff044b9a61421cb68ef4b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Creating volume b7d99900-b813-4c23-a4e8-595f1054e515 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:32 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:32 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 1073741824 Jun 23 14:01:32 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:32 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.894s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Deleted volume successfully. Jun 23 14:01:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2ead9604-3c41-4640-bb8f-00a81a40302b tempest-VolumeQuotasNegativeTestJSON-1074322381 None] Lock "cinder-a83eea47-1af7-4f6b-ac8d-234608ba53c8-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d82604c8-73bf-403e-afb8-9b51917e4624 tempest-VolumesTransfersTest-224942249 None] Transfer volume completed successfully. Jun 23 14:01:33 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 1073741824" returned: 0 in 1.242s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:33 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 Jun 23 14:01:33 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:35 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515" returned: 0 in 1.587s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] <== create_volume: return (2898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.903s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666e6fbe-a086-48dc-8d1d-fc5537391b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d99900-b813-4c23-a4e8-595f1054e515', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561ad889-2f6a-4bb7-8cfa-615057721470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Acquiring lock "cinder-2bde092d-238f-4e6f-9716-b840a3300873-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Volume volume-b7d99900-b813-4c23-a4e8-595f1054e515 (b7d99900-b813-4c23-a4e8-595f1054e515): created successfully Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561ad889-2f6a-4bb7-8cfa-615057721470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Flow 'volume_create_manager' (c3b59577-7efb-43d1-8d7c-c0fedffaec8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Lock "cinder-2bde092d-238f-4e6f-9716-b840a3300873-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a23b5d8f-6320-4251-98a1-105902a27205 tempest-AttachVolumeTestJSON-1522754590 None] Created volume successfully. Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Acquiring lock "cinder-quobyte-2bde092d-238f-4e6f-9716-b840a3300873" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Lock "cinder-quobyte-2bde092d-238f-4e6f-9716-b840a3300873" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1227e369-827f-4dcd-8ed8-a07be13ea9be]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:35 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 Jun 23 14:01:35 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:36 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873" returned: 0 in 1.299s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:36 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873 Jun 23 14:01:36 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:37 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bde092d-238f-4e6f-9716-b840a3300873" returned: 0 in 1.082s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Lock "cinder-quobyte-2bde092d-238f-4e6f-9716-b840a3300873" released by "delete_volume" :: held 2.478s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:37 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Created reservations ['beaa7213-dd4a-4d1d-9ab4-873ad2b0dba1', 'ff859d42-4163-454f-b8f8-5ae7445d682a', '334e3206-d666-4bd7-9617-c59a23a8b9d0', 'c6b07c51-2f89-4a17-96af-10da69c97f97'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:38 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:38 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:39 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.242s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Deleted volume successfully. Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e2089f0-bcdd-47eb-9b98-e05ee4e82a0d tempest-VolumesTransfersTest-888888469 None] Lock "cinder-2bde092d-238f-4e6f-9716-b840a3300873-delete_volume" released by "delete_volume" :: held 4.133s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Flow 'volume_create_manager' (e778d3b2-926a-49c4-881b-f8d30bdbcfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c55c3ba-3d15-479a-b91a-a4e7a155ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c55c3ba-3d15-479a-b91a-a4e7a155ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1312692148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36180b37-c4f0-42e7-8829-887f5a0ddd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e967ae20d4485e916f0634f4d53d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:40Z,use_quota=True,user_id='611f8a3d127a4c02badfcfc9cf2722e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded7044f-9fa2-4123-975c-18e180e5d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded7044f-9fa2-4123-975c-18e180e5d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4838304-c455-4f77-bbba-26833da8dfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4838304-c455-4f77-bbba-26833da8dfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36180b37-c4f0-42e7-8829-887f5a0ddd40', 'volume_name': 'volume-36180b37-c4f0-42e7-8829-887f5a0ddd40', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22d3704-4e97-4c0a-8c08-df31f761bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22d3704-4e97-4c0a-8c08-df31f761bb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae989156-6daa-4e1b-ae50-3ff9b9ba74f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:40 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Volume 36180b37-c4f0-42e7-8829-887f5a0ddd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36180b37-c4f0-42e7-8829-887f5a0ddd40', 'volume_size': 1} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1312692148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36180b37-c4f0-42e7-8829-887f5a0ddd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e967ae20d4485e916f0634f4d53d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:40Z,use_quota=True,user_id='611f8a3d127a4c02badfcfc9cf2722e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Creating volume 36180b37-c4f0-42e7-8829-887f5a0ddd40 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:40 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:40 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 1073741824 Jun 23 14:01:40 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:41 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 1073741824" returned: 0 in 1.356s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:41 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 Jun 23 14:01:41 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:42 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40" returned: 0 in 0.812s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.142s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae989156-6daa-4e1b-ae50-3ff9b9ba74f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36180b37-c4f0-42e7-8829-887f5a0ddd40', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bdaa62-1717-4e46-8ac5-56ba20df6d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ec33e5-8b91-4a55-b69e-f68b1e3f6fc4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:42 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Volume volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 (36180b37-c4f0-42e7-8829-887f5a0ddd40): created successfully Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5bdaa62-1717-4e46-8ac5-56ba20df6d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Flow 'volume_create_manager' (e778d3b2-926a-49c4-881b-f8d30bdbcfed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2c475087-e6e2-4706-b86f-3f8250a684d4 tempest-VolumesTransfersTest-732496748 None] Created volume successfully. Jun 23 14:01:42 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 Jun 23 14:01:42 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Acquiring lock "cinder-36180b37-c4f0-42e7-8829-887f5a0ddd40-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Lock "cinder-36180b37-c4f0-42e7-8829-887f5a0ddd40-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Acquiring lock "cinder-quobyte-36180b37-c4f0-42e7-8829-887f5a0ddd40" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Lock "cinder-quobyte-36180b37-c4f0-42e7-8829-887f5a0ddd40" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:43 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515" returned: 0 in 1.289s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.343s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[152aae03-a598-4aa1-a72b-07fd37626e70]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-b7d99900-b813-4c23-a4e8-595f1054e515', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26578271-f1a3-4af8-a916-0cec0ff75c9d', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:01:43 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 Jun 23 14:01:43 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-ac9a0a36-2c5c-408c-8377-f8ef513bc880 req-6d8f884d-4a78-4458-b9c2-c54b5e521768 tempest-AttachVolumeTestJSON-1522754590 None] attachment_update completed successfully. Jun 23 14:01:44 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40" returned: 0 in 1.264s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:44 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40 Jun 23 14:01:44 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:45 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-36180b37-c4f0-42e7-8829-887f5a0ddd40" returned: 0 in 0.986s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Lock "cinder-quobyte-36180b37-c4f0-42e7-8829-887f5a0ddd40" released by "delete_volume" :: held 2.304s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:45 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Created reservations ['4d1d8f97-de87-454a-9911-d493b5c2ece3', '32a1dde5-a5b9-4c12-afa8-8ee4841598eb', '207d0c74-89f9-4c65-a443-fc6c52094218', 'd0a216e3-9348-4db4-ba54-33d0142f4983'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:46 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:46 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:46 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.864s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Deleted volume successfully. Jun 23 14:01:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc4845e4-c8d2-4bc3-9200-e50559e9f431 tempest-VolumesTransfersTest-888888469 None] Lock "cinder-36180b37-c4f0-42e7-8829-887f5a0ddd40-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Flow 'volume_create_manager' (a807b792-fe44-456c-91c0-2bf403706075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19372a1-9c2b-4f23-b2d2-8105dad910a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19372a1-9c2b-4f23-b2d2-8105dad910a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401236710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337ed4e7-71ba-4e8e-ac7e-31d90418d3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddafef8b29d4d53a12a93ab321b2303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:51Z,use_quota=True,user_id='8b9e5390f7ce4741837a4ef5a3f856a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54cdbd06-a066-443e-ba00-106974a82ef2),volume_type_id=54cdbd06-a066-443e-ba00-106974a82ef2)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a465e7a-e595-42fe-ad9d-a90d69c2d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a465e7a-e595-42fe-ad9d-a90d69c2d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907e869f-cbe0-416b-92de-516e71fe2732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907e869f-cbe0-416b-92de-516e71fe2732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337ed4e7-71ba-4e8e-ac7e-31d90418d3ca', 'volume_name': 'volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9454ad-b8b5-4cd4-925d-bca23fd7030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9454ad-b8b5-4cd4-925d-bca23fd7030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5c7d84-af84-4fc2-aeb0-74f439599d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:50 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Volume 337ed4e7-71ba-4e8e-ac7e-31d90418d3ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca', 'volume_size': 1} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1401236710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337ed4e7-71ba-4e8e-ac7e-31d90418d3ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddafef8b29d4d53a12a93ab321b2303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:51Z,use_quota=True,user_id='8b9e5390f7ce4741837a4ef5a3f856a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54cdbd06-a066-443e-ba00-106974a82ef2),volume_type_id=54cdbd06-a066-443e-ba00-106974a82ef2)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Creating volume 337ed4e7-71ba-4e8e-ac7e-31d90418d3ca {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:50 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:50 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca 1073741824 Jun 23 14:01:50 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-9541f981-e838-4275-8234-945c488b4295 req-d2586263-9970-4f57-83fd-6a41278e8fa6 tempest-AttachVolumeTestJSON-1522754590 None] Terminate volume connection completed successfully. Jun 23 14:01:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-9541f981-e838-4275-8234-945c488b4295 req-d2586263-9970-4f57-83fd-6a41278e8fa6 tempest-AttachVolumeTestJSON-1522754590 None] Deleting attachment 3b71f747-0078-4436-bc11-da8242b405d9. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:51 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:51 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:52 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca 1073741824" returned: 0 in 1.284s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:52 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca Jun 23 14:01:52 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:52 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.981s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:01:52 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca" returned: 0 in 0.781s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5c7d84-af84-4fc2-aeb0-74f439599d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd017b3c-f8d9-433b-b484-5df820095d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Volume volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca (337ed4e7-71ba-4e8e-ac7e-31d90418d3ca): created successfully Jun 23 14:01:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd017b3c-f8d9-433b-b484-5df820095d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Flow 'volume_create_manager' (a807b792-fe44-456c-91c0-2bf403706075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b5f1dbde-7cac-438e-9f34-9fe15539f9c9 tempest-VolumeTypesAccessTest-1577691171 None] Created volume successfully. Jun 23 14:01:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-b8bd833e-e405-46b5-a086-c6fbe5567173 req-707e3758-9e19-4fe7-8fa0-081a6349dea9 tempest-AttachVolumeTestJSON-1522754590 None] Terminate volume connection completed successfully. Jun 23 14:01:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-b8bd833e-e405-46b5-a086-c6fbe5567173 req-707e3758-9e19-4fe7-8fa0-081a6349dea9 tempest-AttachVolumeTestJSON-1522754590 None] Deleting attachment 26578271-f1a3-4af8-a916-0cec0ff75c9d. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Acquiring lock "cinder-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (013b20d7-2e27-4c7f-8dc1-bfff8b6a1b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8e8add-2a15-4783-a32d-961a59c4ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Lock "cinder-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8e8add-2a15-4783-a32d-961a59c4ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1688861148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca090da-7370-459e-90c5-92e348559b66,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:54Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0702c3ad-4e20-4519-a3e2-bbc4cb02b43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0702c3ad-4e20-4519-a3e2-bbc4cb02b43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53fb2c-a436-4859-8696-95af786c1aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53fb2c-a436-4859-8696-95af786c1aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca090da-7370-459e-90c5-92e348559b66', 'volume_name': 'volume-bca090da-7370-459e-90c5-92e348559b66', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d80606-d9b1-416c-a84b-8ba55848887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d80606-d9b1-416c-a84b-8ba55848887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64d1deb-7bd4-4a9d-b251-47dda13f607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:54 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Volume bca090da-7370-459e-90c5-92e348559b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca090da-7370-459e-90c5-92e348559b66', 'volume_size': 1} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1688861148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca090da-7370-459e-90c5-92e348559b66,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:54Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Creating volume bca090da-7370-459e-90c5-92e348559b66 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:54 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:54 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 1073741824 Jun 23 14:01:54 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Acquiring lock "cinder-quobyte-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Lock "cinder-quobyte-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41fb095-c228-4681-83d9-3d3c76ba3ca6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:01:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:54 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca Jun 23 14:01:54 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:55 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca" returned: 0 in 0.974s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:55 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 1073741824" returned: 0 in 1.081s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:55 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca Jun 23 14:01:55 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:55 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 Jun 23 14:01:55 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:56 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca" returned: 0 in 0.962s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Lock "cinder-quobyte-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca" released by "delete_volume" :: held 2.001s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:56 devstack cinder-volume[93605]: WARNING cinder.quota [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1497989606 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1497989606, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:01:56 devstack cinder-volume[93605]: WARNING cinder.quota [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1497989606 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1497989606, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Created reservations ['1221b3e7-3948-4997-8a5b-a6bdafe06674', 'dc63fbdd-29aa-4a94-a9d3-08be59d3e16b', '807cb4e2-f67c-4382-910c-5f6a82ded2f3', 'e75b4366-0242-4802-be06-e5bb487e561b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:01:56 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66" returned: 0 in 1.126s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64d1deb-7bd4-4a9d-b251-47dda13f607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca090da-7370-459e-90c5-92e348559b66', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30a64ea-5d15-42ac-bf11-297f4eb1e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Volume volume-bca090da-7370-459e-90c5-92e348559b66 (bca090da-7370-459e-90c5-92e348559b66): created successfully Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30a64ea-5d15-42ac-bf11-297f4eb1e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (013b20d7-2e27-4c7f-8dc1-bfff8b6a1b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:56 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:01:56 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:01:56 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-180dd101-fb6d-48ae-9584-90a3f84fba16 tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:01:57 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jun 23 14:01:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.004s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:01:57 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:01:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Deleted volume successfully. Jun 23 14:01:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9758e23b-96ca-4c76-9ac1-a8ea6484daff tempest-VolumeTypesAccessTest-1577691171 None] Lock "cinder-337ed4e7-71ba-4e8e-ac7e-31d90418d3ca-delete_volume" released by "delete_volume" :: held 3.517s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (659ef139-ba5a-4709-91d1-46a215900015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e1edad-6e6a-4483-b299-24dbb1d0b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e1edad-6e6a-4483-b299-24dbb1d0b777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-385364867',display_name='tempest-VolumesGetTest-Volume-195120239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36f8872-a342-4a5c-9d97-ebac26fa1a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:59Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e61821b-8da5-4f58-b90c-5ff27e6805d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e61821b-8da5-4f58-b90c-5ff27e6805d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6755c780-f9d2-47f5-9bc5-2e28f705f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6755c780-f9d2-47f5-9bc5-2e28f705f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36f8872-a342-4a5c-9d97-ebac26fa1a3e', 'volume_name': 'volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0582d38-864f-41f1-8b96-1be9db8046c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0582d38-864f-41f1-8b96-1be9db8046c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ef25c-3204-48f6-96da-98a1997fb8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:01:58 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Volume e36f8872-a342-4a5c-9d97-ebac26fa1a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e', 'volume_size': 1} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:01:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-385364867',display_name='tempest-VolumesGetTest-Volume-195120239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36f8872-a342-4a5c-9d97-ebac26fa1a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:01:59Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Creating volume e36f8872-a342-4a5c-9d97-ebac26fa1a3e {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:01:58 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:01:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:01:58 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e 1073741824 Jun 23 14:01:58 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:00 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e 1073741824" returned: 0 in 1.228s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:00 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e Jun 23 14:02:00 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:01 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e" returned: 0 in 1.014s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ef25c-3204-48f6-96da-98a1997fb8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3bf808-5bbe-4201-b90a-f5940fa0029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:01 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Volume volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e (e36f8872-a342-4a5c-9d97-ebac26fa1a3e): created successfully Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3bf808-5bbe-4201-b90a-f5940fa0029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (659ef139-ba5a-4709-91d1-46a215900015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Flow 'volume_create_manager' (bc613e26-0a2d-4f38-97d6-36d9444caf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7694361-f510-49ea-b28d-f6800f183860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7694361-f510-49ea-b28d-f6800f183860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1165134868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41bba17-183a-463b-9bb6-766460fbc53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdda29a849464f84c0ae172a3a0e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:01Z,use_quota=True,user_id='fd3220a032f74cee814b047eff00c9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daaa261-3bc5-48ad-afed-0fd7964512be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7daaa261-3bc5-48ad-afed-0fd7964512be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b332e33b-e8a6-4463-b803-1d308a09b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b332e33b-e8a6-4463-b803-1d308a09b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41bba17-183a-463b-9bb6-766460fbc53c', 'volume_name': 'volume-e41bba17-183a-463b-9bb6-766460fbc53c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2bd9b-e81a-445a-ade2-f2519bbfe2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce2bd9b-e81a-445a-ade2-f2519bbfe2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa0962d-a8f7-4343-b8a3-bb7fa2b34368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:01 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Volume e41bba17-183a-463b-9bb6-766460fbc53c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41bba17-183a-463b-9bb6-766460fbc53c', 'volume_size': 1} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1165134868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41bba17-183a-463b-9bb6-766460fbc53c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acbdda29a849464f84c0ae172a3a0e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:01Z,use_quota=True,user_id='fd3220a032f74cee814b047eff00c9cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Creating volume e41bba17-183a-463b-9bb6-766460fbc53c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:01 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:02:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c4ccf2c5-2acc-4e22-b75d-61b002a4b00b tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:02:01 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c 1073741824 Jun 23 14:02:01 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-e36f8872-a342-4a5c-9d97-ebac26fa1a3e-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Lock "cinder-e36f8872-a342-4a5c-9d97-ebac26fa1a3e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-e36f8872-a342-4a5c-9d97-ebac26fa1a3e" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-e36f8872-a342-4a5c-9d97-ebac26fa1a3e" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213b882-c0c2-49c4-b704-6efe05e73e76]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:02 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e Jun 23 14:02:02 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:02 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c 1073741824" returned: 0 in 1.236s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:02 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c Jun 23 14:02:02 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:03 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c" returned: 0 in 0.903s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:03 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e" returned: 0 in 1.138s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa0962d-a8f7-4343-b8a3-bb7fa2b34368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41bba17-183a-463b-9bb6-766460fbc53c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79678fae-8409-42d0-8151-c7ebead97e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:03 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e Jun 23 14:02:03 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:03 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Volume volume-e41bba17-183a-463b-9bb6-766460fbc53c (e41bba17-183a-463b-9bb6-766460fbc53c): created successfully Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79678fae-8409-42d0-8151-c7ebead97e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Flow 'volume_create_manager' (bc613e26-0a2d-4f38-97d6-36d9444caf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2ab0db45-bdfc-458c-9d1e-1aeddb28d21c tempest-AttachVolumeNegativeTest-1318192135 None] Created volume successfully. Jun 23 14:02:04 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e36f8872-a342-4a5c-9d97-ebac26fa1a3e" returned: 0 in 0.812s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-e36f8872-a342-4a5c-9d97-ebac26fa1a3e" released by "delete_volume" :: held 2.005s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Created reservations ['ac6faa5b-ea8c-4c5b-9dd4-96fb21c7c6d0', '17d1e741-f74a-4294-992d-2aa71398350f', 'f68003b1-898a-4117-90c3-5ec55f05dbc9', '7f760f8d-65d3-4405-9e38-1bbb4e176a8f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:04 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:04 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:05 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.857s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4ff2a188-a26d-4e75-b8a1-e12ccfbadd0f tempest-VolumesGetTest-819033561 None] Lock "cinder-e36f8872-a342-4a5c-9d97-ebac26fa1a3e-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "cinder-b7d99900-b813-4c23-a4e8-595f1054e515-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-b7d99900-b813-4c23-a4e8-595f1054e515-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "cinder-quobyte-b7d99900-b813-4c23-a4e8-595f1054e515" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-quobyte-b7d99900-b813-4c23-a4e8-595f1054e515" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6ab6c-00ab-47bd-bd52-e646eaa110e9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-bca090da-7370-459e-90c5-92e348559b66-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Lock "cinder-bca090da-7370-459e-90c5-92e348559b66-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-bca090da-7370-459e-90c5-92e348559b66" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-bca090da-7370-459e-90c5-92e348559b66" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[590d670b-323e-4952-9907-72621b6919c8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:05 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 Jun 23 14:02:05 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:06 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 Jun 23 14:02:06 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:06 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515" returned: 0 in 1.086s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:06 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515 Jun 23 14:02:06 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:06 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66" returned: 0 in 1.041s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:06 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66 Jun 23 14:02:06 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:07 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7d99900-b813-4c23-a4e8-595f1054e515" returned: 0 in 0.799s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-quobyte-b7d99900-b813-4c23-a4e8-595f1054e515" released by "delete_volume" :: held 1.963s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Created reservations ['9c830be4-04d5-489b-858c-dad455790ae8', '269c2a9a-9298-40e3-af67-9cd7d79f37f1', '6505869a-e895-4d49-935d-35abe498c897', '2bd1aff3-e463-4cc3-b3e0-044862bae3ee'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8c0ba-0bdb-4019-860f-0faaa0a6d999]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:07 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bca090da-7370-459e-90c5-92e348559b66" returned: 0 in 0.938s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:07 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:07 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-bca090da-7370-459e-90c5-92e348559b66" released by "delete_volume" :: held 2.047s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:07 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c Jun 23 14:02:07 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "cinder-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Created reservations ['597befd8-e296-462f-b20a-2a9f911d81e7', 'c05ec68e-b989-4dab-afa0-56aff7e00334', '7eab5241-a9ad-47c1-a36f-09074212297e', 'ae4b103c-675e-482b-917b-7acab1c9f55f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "cinder-quobyte-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-quobyte-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" acquired by "delete_volume" :: waited 0.069s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c363734-9eab-4124-9725-665c5b80ad70]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:08 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:08 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:08 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d Jun 23 14:02:08 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:08 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.123s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:08 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Deleted volume successfully. Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-94ed6a2b-ed3e-4bb9-b65a-4af2e505ae5e tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-b7d99900-b813-4c23-a4e8-595f1054e515-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:09 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c" returned: 0 in 1.301s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.328s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-e41bba17-183a-463b-9bb6-766460fbc53c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc7e170b-2cb6-4d23-8597-baba675535a9', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:02:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-99e414d9-135e-4ac7-9557-8d01062132ae req-074e5e48-25a2-4c22-a130-3a705486cf26 tempest-AttachVolumeNegativeTest-1318192135 None] attachment_update completed successfully. Jun 23 14:02:09 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.070s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17650da0-7570-4e65-aa56-576a43488122 tempest-VolumesGetTest-819033561 None] Lock "cinder-bca090da-7370-459e-90c5-92e348559b66-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:09 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" returned: 0 in 1.185s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:09 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d Jun 23 14:02:09 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:09 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (ca6d5b0a-fa78-4afb-8a0a-4fb6496f0bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f99ba9-fbf1-4b16-8f9f-9bc8bd19d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f99ba9-fbf1-4b16-8f9f-9bc8bd19d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1991387853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3878bb3-d0f2-45bf-934c-b23eec665d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:10Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfffde9-9428-4e4e-9ec8-1d690db961cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecfffde9-9428-4e4e-9ec8-1d690db961cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b06d10-4ac8-4517-a362-adca3d2c6642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b06d10-4ac8-4517-a362-adca3d2c6642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3878bb3-d0f2-45bf-934c-b23eec665d6f', 'volume_name': 'volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07ee287-452b-4db6-8ae1-27f4986eeac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07ee287-452b-4db6-8ae1-27f4986eeac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860bb39e-b2b5-43a2-9f4a-2eea093b1df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:10 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Volume d3878bb3-d0f2-45bf-934c-b23eec665d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f', 'volume_size': 1} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1991387853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3878bb3-d0f2-45bf-934c-b23eec665d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:10Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Creating volume d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:10 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:10 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f 1073741824 Jun 23 14:02:10 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:10 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" returned: 0 in 0.947s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-quobyte-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d" released by "delete_volume" :: held 2.227s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Created reservations ['4557961c-f2dc-4a76-a834-0ba3cc71baaa', '586682aa-50f8-412d-abf5-c893371514a9', '7c1857e7-d12a-47ae-b0d3-955618aefce4', '57a673ad-446c-41c9-9a19-ed70a6af9240'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:10 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:10 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:11 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f 1073741824" returned: 0 in 1.228s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:11 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:11 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "cinder-843709a8-a710-424b-87be-44e830cbced1-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-843709a8-a710-424b-87be-44e830cbced1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "cinder-quobyte-843709a8-a710-424b-87be-44e830cbced1" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-quobyte-843709a8-a710-424b-87be-44e830cbced1" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[07247093-30ca-4685-8112-f7603e366800]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:11 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.022s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Deleted volume successfully. Jun 23 14:02:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-102ebae7-43ab-4eaa-b162-ee47592793ad tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-4dd76edc-e8cc-4692-b1c2-1b97d7702d7d-delete_volume" released by "delete_volume" :: held 3.655s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:11 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 Jun 23 14:02:11 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:12 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 0.887s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860bb39e-b2b5-43a2-9f4a-2eea093b1df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa503ca9-4f34-4f5c-9be8-94ff0940db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:12 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Volume volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f (d3878bb3-d0f2-45bf-934c-b23eec665d6f): created successfully Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa503ca9-4f34-4f5c-9be8-94ff0940db1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (ca6d5b0a-fa78-4afb-8a0a-4fb6496f0bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-25be8393-98ba-476e-8a03-e32315212a89 tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:02:12 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1" returned: 0 in 1.001s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:12 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1 Jun 23 14:02:12 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:13 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-843709a8-a710-424b-87be-44e830cbced1" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-quobyte-843709a8-a710-424b-87be-44e830cbced1" released by "delete_volume" :: held 1.865s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Created reservations ['ac82ff98-f7cd-458c-869d-f8e5d474d074', 'b3a9ea58-f810-4c7d-b7a8-e1bd2c182f68', '44537d58-1f68-4241-ae47-7f09e19c30f9', '0974bb55-b6e2-4781-a9d4-b87cbaf67f3f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:13 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:13 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (4c742f40-11df-4b25-99a2-72c06d52ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dae616-c0ad-498a-ab76-0fa3afbc5ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dae616-c0ad-498a-ab76-0fa3afbc5ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1814383378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d3878bb3-d0f2-45bf-934c-b23eec665d6f,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:14Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8d6065-94d2-40a0-a8d6-ab4dea87845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8d6065-94d2-40a0-a8d6-ab4dea87845e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a44df15-f4a9-4d29-a00b-03508e378476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a44df15-f4a9-4d29-a00b-03508e378476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a', 'volume_name': 'volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a', 'volume_size': 1, 'source_volid': 'd3878bb3-d0f2-45bf-934c-b23eec665d6f', 'source_volstatus': 'available'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a344c53-3402-4151-9e07-a9b6b7b4807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a344c53-3402-4151-9e07-a9b6b7b4807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd2caf-5f4a-4b52-b68e-fd0cd3bd0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:14 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Volume e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a', 'volume_size': 1, 'source_volid': 'd3878bb3-d0f2-45bf-934c-b23eec665d6f', 'source_volstatus': 'available'} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:14 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Cloning volume d3878bb3-d0f2-45bf-934c-b23eec665d6f to volume e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Creating offline snapshot 0d5e5de6-971e-4cd0-a404-a78572f804d9 of volume d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebb1dad-8d3b-4fae-8925-c7a1a151903a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:14 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:14 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:14 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.178s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Deleted volume successfully. Jun 23 14:02:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6a292b42-db91-4ec8-98e8-d8f74dbdef82 tempest-AttachVolumeTestJSON-1522754590 None] Lock "cinder-843709a8-a710-424b-87be-44e830cbced1-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:15 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 1.264s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:15 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 1G Jun 23 14:02:15 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-a504f636-b670-4ba7-8468-d1ea1ad840ea req-cb0f03d7-2564-4fe6-b793-e22043db9ab8 tempest-AttachVolumeNegativeTest-1318192135 None] Terminate volume connection completed successfully. Jun 23 14:02:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-a504f636-b670-4ba7-8468-d1ea1ad840ea req-cb0f03d7-2564-4fe6-b793-e22043db9ab8 tempest-AttachVolumeNegativeTest-1318192135 None] Deleting attachment cc7e170b-2cb6-4d23-8597-baba675535a9. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:02:16 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 1G" returned: 0 in 1.205s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:16 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 Jun 23 14:02:16 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:17 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9" returned: 0 in 1.037s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:17 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 is being set with open permissions: ugo+rw Jun 23 14:02:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:17 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 Jun 23 14:02:17 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:18 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9" returned: 0 in 0.959s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:18 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info Jun 23 14:02:18 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:19 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info" returned: 0 in 1.093s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:19 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info is being set with open permissions: ugo+rw Jun 23 14:02:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:20 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info Jun 23 14:02:20 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:21 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.info" returned: 0 in 1.066s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] snapshot: 0d5e5de6-971e-4cd0-a404-a78572f804d9, volume: e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273fa26-6dd9-4d71-bae1-c591a70c684f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:21 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 Jun 23 14:02:21 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:22 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9" returned: 0 in 1.391s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:02:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:02:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:02:22 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2da933c-7d7f-4b01-be95-2b85bf622112]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:22 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:22 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:23 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 1.150s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:23 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:02:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:23 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a Jun 23 14:02:23 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:28 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=78,cinder:UPDATE=95,cinder:INSERT=25,cinder:DELETE=9 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:02:28 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=107,cinder:DELETE=9,cinder:SELECT=82,cinder:INSERT=21 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:02:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" returned: 0 in 7.169s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77e2c5d-2216-4a1f-bd8d-a69a2cbb1887]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:31 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:31 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "cinder-e41bba17-183a-463b-9bb6-766460fbc53c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-e41bba17-183a-463b-9bb6-766460fbc53c-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "cinder-quobyte-e41bba17-183a-463b-9bb6-766460fbc53c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-quobyte-e41bba17-183a-463b-9bb6-766460fbc53c" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:31 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8cc77-620d-45e9-98ad-054a75c8ef70]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:31 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c Jun 23 14:02:31 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:32 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 1.460s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:32 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:02:32 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Converted 1024.00 MB image at 142.77 MB/s Jun 23 14:02:32 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a is being set with open permissions: ugo+rw Jun 23 14:02:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:32 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a Jun 23 14:02:32 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:32 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c" returned: 0 in 1.287s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:32 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c Jun 23 14:02:32 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:33 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" returned: 0 in 0.870s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" released by "_copy_volume_from_snapshot" :: held 12.194s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-0d5e5de6-971e-4cd0-a404-a78572f804d9" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-0d5e5de6-971e-4cd0-a404-a78572f804d9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Deleting offline snapshot 0d5e5de6-971e-4cd0-a404-a78572f804d9 of volume d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] snapshot_file for this snap is: volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8431b809-7091-4be3-8473-153f573271c3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:33 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 Jun 23 14:02:33 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:33 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e41bba17-183a-463b-9bb6-766460fbc53c" returned: 0 in 1.074s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-quobyte-e41bba17-183a-463b-9bb6-766460fbc53c" released by "delete_volume" :: held 2.435s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Created reservations ['66a54b33-45bc-4263-b677-55c3fc631c73', '95f4f62a-db04-4b7d-a0c2-430ff499eb4e', '8c464713-70dc-4569-bc27-d9550fd09cce', '6d496b73-3d75-4d3e-9f3b-deca82a569a6'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:34 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:34 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:34 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9" returned: 0 in 1.223s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece1c56-48ef-430b-b43c-b5c6becede81]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:34 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:34 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "cinder-4c837388-f5e5-466e-a2e6-455d6050fc26-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-4c837388-f5e5-466e-a2e6-455d6050fc26-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "cinder-quobyte-4c837388-f5e5-466e-a2e6-455d6050fc26" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-quobyte-4c837388-f5e5-466e-a2e6-455d6050fc26" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa6ffe9-5ff9-4f08-84d7-7e80e6d9a61a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:35 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.038s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Deleted volume successfully. Jun 23 14:02:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-650fddaa-4a80-4596-9aa4-ff8791b29830 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-e41bba17-183a-463b-9bb6-766460fbc53c-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:35 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 Jun 23 14:02:35 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:35 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 1.271s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:36 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 Jun 23 14:02:36 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:36 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26" returned: 0 in 1.331s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:36 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26 Jun 23 14:02:36 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:37 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9" returned: 0 in 1.203s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:37 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9 Jun 23 14:02:37 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:37 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4c837388-f5e5-466e-a2e6-455d6050fc26" returned: 0 in 1.038s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-quobyte-4c837388-f5e5-466e-a2e6-455d6050fc26" released by "delete_volume" :: held 2.447s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Created reservations ['2a77616b-5a4e-4f88-abe9-b435781d224a', '2ad7cb96-b934-45a4-9057-2bad5b6f2eea', '098d3479-2cde-427d-982b-40fd3a46aef7', '2fd54f9a-fca5-4cee-a207-12126434dc6f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:37 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:37 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:38 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f.0d5e5de6-971e-4cd0-a404-a78572f804d9" returned: 0 in 1.019s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-0d5e5de6-971e-4cd0-a404-a78572f804d9" released by "_delete_snapshot" :: held 4.903s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.135s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bd2caf-5f4a-4b52-b68e-fd0cd3bd0d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a', 'volume_size': 1, 'source_volid': 'd3878bb3-d0f2-45bf-934c-b23eec665d6f', 'source_volstatus': 'available'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0f1cf2-3283-4dd3-bcee-17be7a2c384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Volume volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a (e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a): created successfully Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0f1cf2-3283-4dd3-bcee-17be7a2c384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (4c742f40-11df-4b25-99a2-72c06d52ee90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-77e27de2-ab71-4152-89dc-3da0969f028a tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:02:38 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.861s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Deleted volume successfully. Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5237d289-8242-4838-983a-710c600ed6fb tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-4c837388-f5e5-466e-a2e6-455d6050fc26-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "cinder-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "cinder-quobyte-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-quobyte-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:39 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e0f5b-6012-4169-b16d-2a5abb1713d8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:39 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 Jun 23 14:02:39 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (3ce17503-3360-4114-ac88-7197c28e380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bc123f-5264-4c7c-8b34-7bd5896b4605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bc123f-5264-4c7c-8b34-7bd5896b4605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-498271553',display_name='tempest-VolumesGetTest-Volume-13495435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766916dd-b3f9-4ee9-9fa7-5b5367a4af51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:40Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c164c7d-c97c-4535-8846-e4925596e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c164c7d-c97c-4535-8846-e4925596e41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad993d7-824f-40bc-92c0-f9639243858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad993d7-824f-40bc-92c0-f9639243858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766916dd-b3f9-4ee9-9fa7-5b5367a4af51', 'volume_name': 'volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f81ba5-d7f0-4835-92cd-dff150578418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f81ba5-d7f0-4835-92cd-dff150578418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d05c039-e779-4393-ab35-5968b4fbc34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:40 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Volume 766916dd-b3f9-4ee9-9fa7-5b5367a4af51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51', 'volume_size': 1} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-498271553',display_name='tempest-VolumesGetTest-Volume-13495435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766916dd-b3f9-4ee9-9fa7-5b5367a4af51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:40Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Creating volume 766916dd-b3f9-4ee9-9fa7-5b5367a4af51 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:40 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:40 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" returned: 0 in 1.207s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:40 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 1073741824 Jun 23 14:02:40 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:40 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46 Jun 23 14:02:40 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:41 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" returned: 0 in 0.908s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-quobyte-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46" released by "delete_volume" :: held 2.187s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Created reservations ['2844ccef-8117-44bf-8c13-78d1b9d0cfdb', 'c21120da-916e-4f0c-af4b-687ca7c531d0', 'f3ee8e1d-1c0c-4c29-9570-f1169991e591', '7e70b702-0dd9-4a0c-9d53-8030250ded26'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Flow 'volume_create_manager' (78847d54-0778-457a-be8a-e5c824b587f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da39a43-407a-4c31-a133-27b695954ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da39a43-407a-4c31-a133-27b695954ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1516766339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519ac7f8-a22f-4ba4-965e-3e30c148e36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb91f03667e4aa0bd1a4704629419bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:41Z,use_quota=True,user_id='41481d030fdf4427bc74d9ef26b0be44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494498b3-7705-49b4-81f2-ff257badc653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494498b3-7705-49b4-81f2-ff257badc653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd57a8d6-2eec-4a4e-ad9d-36283b033b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd57a8d6-2eec-4a4e-ad9d-36283b033b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519ac7f8-a22f-4ba4-965e-3e30c148e36b', 'volume_name': 'volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1409c589-929f-4cae-883a-52c738610dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1409c589-929f-4cae-883a-52c738610dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92c8be0-d258-49de-8618-615ffa204c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Volume 519ac7f8-a22f-4ba4-965e-3e30c148e36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b', 'volume_size': 1} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:41 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 1073741824" returned: 0 in 1.271s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:41 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:41 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:41 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 Jun 23 14:02:41 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Flow 'volume_create_manager' (c17c424b-b89b-4320-b8a7-fae7bdb936d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd384a68-570c-41f3-b905-fb7858175fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd384a68-570c-41f3-b905-fb7858175fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-797470672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b2ef775f1246be988b523234387968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:42Z,use_quota=True,user_id='814d780c0e834aecb4526c71e0e86011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46d37c9b-72d3-4d6d-a800-1cbb4f3f4872),volume_type_id=46d37c9b-72d3-4d6d-a800-1cbb4f3f4872)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8048e9e1-5d6c-42f0-8ab9-3d3ed76cbfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8048e9e1-5d6c-42f0-8ab9-3d3ed76cbfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9e6682-12d2-4916-8679-60bf03065e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9e6682-12d2-4916-8679-60bf03065e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da', 'volume_name': 'volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3eea78-35f6-49f9-aa46-0c1567c9b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec3eea78-35f6-49f9-aa46-0c1567c9b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79eb58c-ebc8-440a-bb20-bf03da3fb897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:41 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Volume dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da', 'volume_size': 1} Jun 23 14:02:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:42 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.853s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Deleted volume successfully. Jun 23 14:02:42 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51" returned: 0 in 0.818s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1516766339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519ac7f8-a22f-4ba4-965e-3e30c148e36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb91f03667e4aa0bd1a4704629419bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:41Z,use_quota=True,user_id='41481d030fdf4427bc74d9ef26b0be44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Creating volume 519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:42 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01d11c91-6d55-4336-816e-fdf4c87384c7 tempest-AttachVolumeNegativeTest-1318192135 None] Lock "cinder-5e2bc1d2-f7e9-4bd4-8531-5a777ae0be46-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:42 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b 1073741824 Jun 23 14:02:42 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d05c039-e779-4393-ab35-5968b4fbc34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e1381c-aeab-4b44-8af2-16997794a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:42 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Volume volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 (766916dd-b3f9-4ee9-9fa7-5b5367a4af51): created successfully Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e1381c-aeab-4b44-8af2-16997794a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (3ce17503-3360-4114-ac88-7197c28e380f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fdab8706-9895-48f5-a28f-b1bdead52fa9 tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:02:43 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-766916dd-b3f9-4ee9-9fa7-5b5367a4af51-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b 1073741824" returned: 0 in 1.063s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Lock "cinder-766916dd-b3f9-4ee9-9fa7-5b5367a4af51-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:43 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:02:43 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-766916dd-b3f9-4ee9-9fa7-5b5367a4af51" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-766916dd-b3f9-4ee9-9fa7-5b5367a4af51" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e8a4e8-4307-4759-8743-166d393f35c9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:43 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 Jun 23 14:02:43 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:44 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 0.859s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.518s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-797470672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b2ef775f1246be988b523234387968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:42Z,use_quota=True,user_id='814d780c0e834aecb4526c71e0e86011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46d37c9b-72d3-4d6d-a800-1cbb4f3f4872),volume_type_id=46d37c9b-72d3-4d6d-a800-1cbb4f3f4872)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Creating volume dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:44 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92c8be0-d258-49de-8618-615ffa204c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:44 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da 1073741824 Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cf4b0a-7015-4245-ad11-120abc60e75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:44 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:44 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Volume volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b (519ac7f8-a22f-4ba4-965e-3e30c148e36b): created successfully Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cf4b0a-7015-4245-ad11-120abc60e75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Flow 'volume_create_manager' (78847d54-0778-457a-be8a-e5c824b587f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7489f762-3f54-489e-8c84-7e681dcb8935 tempest-VolumesActionsTest-116464932 None] Created volume successfully. Jun 23 14:02:44 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51" returned: 0 in 1.078s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:44 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51 Jun 23 14:02:44 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:45 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-766916dd-b3f9-4ee9-9fa7-5b5367a4af51" returned: 0 in 0.843s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-766916dd-b3f9-4ee9-9fa7-5b5367a4af51" released by "delete_volume" :: held 1.995s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:45 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da 1073741824" returned: 0 in 1.255s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Created reservations ['7794fc7d-a438-44e1-8e3a-699ff0ffcdee', 'a3e5d302-265d-48e5-8d15-927e4ac91dc0', '0c1b0422-3d35-48f3-b765-96ed9ad30b7f', '6bf79fa8-d1e7-4ade-8990-a3f39fbf0693'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:45 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da Jun 23 14:02:45 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:45 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:45 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Lock "cinder-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b847ed-940a-4e29-b318-cb29c89638e7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:46 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a Jun 23 14:02:46 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:46 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da" returned: 0 in 1.163s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] <== create_volume: return (2509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79eb58c-ebc8-440a-bb20-bf03da3fb897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066f4d3-3018-4dcb-b186-7f45008ef911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:47 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Volume volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da (dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da): created successfully Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5066f4d3-3018-4dcb-b186-7f45008ef911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Flow 'volume_create_manager' (c17c424b-b89b-4320-b8a7-fae7bdb936d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-af1a9551-67fe-447f-8f7d-b6c361e88f76 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Created volume successfully. Jun 23 14:02:47 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.199s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-81c4676a-5a70-4741-9dd4-423f534fc583 tempest-VolumesGetTest-819033561 None] Lock "cinder-766916dd-b3f9-4ee9-9fa7-5b5367a4af51-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:47 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" returned: 0 in 1.203s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:47 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a Jun 23 14:02:47 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:48 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:48 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:48 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" returned: 0 in 1.282s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a" released by "delete_volume" :: held 2.564s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Created reservations ['41aeb6e9-6b19-4a64-b87a-486a0aefcd01', '211db5d8-5c58-4178-8656-27239506e016', 'a2ad6b54-c6d1-4f4f-886e-c5da2c378606', 'f2f70417-a0be-44b9-94ea-6493434141b6'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:49 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.115s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b97e7968-a7be-4ded-ab96-e3bbd9a64ef0 tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Retype volume completed successfully. Jun 23 14:02:49 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:49 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Acquiring lock "cinder-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "cinder-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Acquiring lock "cinder-quobyte-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "cinder-quobyte-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1503d0-542d-49e1-a193-a028d6aebdcb]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-d3878bb3-d0f2-45bf-934c-b23eec665d6f-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:49 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da Jun 23 14:02:49 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Lock "cinder-d3878bb3-d0f2-45bf-934c-b23eec665d6f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-d3878bb3-d0f2-45bf-934c-b23eec665d6f" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:02:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-d3878bb3-d0f2-45bf-934c-b23eec665d6f" acquired by "delete_volume" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd89c4-8973-4412-a7c7-ccfaac924b9b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:50 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:50 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:50 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.068s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b7b41ab1-9e62-4554-8940-8b54dc84890e tempest-VolumesGetTest-819033561 None] Lock "cinder-e72d635f-89ba-4ac0-9d3a-79c5adbf5c2a-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:50 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da" returned: 0 in 1.089s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:50 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da Jun 23 14:02:50 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:51 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 1.231s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:51 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f Jun 23 14:02:51 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:51 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:51 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da" returned: 0 in 1.011s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:51 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "cinder-quobyte-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da" released by "delete_volume" :: held 2.198s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:51 devstack cinder-volume[93605]: WARNING cinder.quota [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:02:51 devstack cinder-volume[93605]: WARNING cinder.quota [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Created reservations ['aaf8da4f-85d0-4bb3-8c2f-05dd7dbd5c19', '21428321-57cd-4c14-bffb-d20da0d436b1', 'f19d15ff-40a4-4a20-a1a8-7cdab98ddc86', '1c306ae9-2e89-4f09-966c-9a73dd22336a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:52 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:52 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:52 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d3878bb3-d0f2-45bf-934c-b23eec665d6f" returned: 0 in 0.964s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-d3878bb3-d0f2-45bf-934c-b23eec665d6f" released by "delete_volume" :: held 2.296s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Created reservations ['2e77050e-51ed-4c18-8ea4-d4ae2d322759', 'ec279614-086d-4b4b-880d-db893505f497', 'e958cc6e-8652-4d61-a30d-1fe69558af0d', 'e6037352-ef00-4a5e-a747-9d271cd80478'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:52 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:02:52 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:52 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.975s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 8 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:02:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:02:53 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.079s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Deleted volume successfully. Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-80a4ab93-047a-477d-90d8-de4d4a5251ab tempest-VolumeRetypeWithoutMigrationTest-1943048251 None] Lock "cinder-dde91e03-9a09-4d0f-b2a0-7e4f8e28d0da-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:53 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.249s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:02:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Flow 'volume_create_manager' (86837f8a-1cf0-4951-b798-31d57dec3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d606cfab-4b03-4eea-bd0f-9c3c714472a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c11e439e-ac8e-4019-a105-371e567ad857 tempest-VolumesGetTest-819033561 None] Lock "cinder-d3878bb3-d0f2-45bf-934c-b23eec665d6f-delete_volume" released by "delete_volume" :: held 4.077s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d606cfab-4b03-4eea-bd0f-9c3c714472a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2120995707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27b0174-e123-483c-882f-8aa09a079164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26f444edd644216848e7a993547a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:54Z,use_quota=True,user_id='311bee7480e14dbf9820ab9fbddc1939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed35d50-08a0-4899-99a7-3d368becf985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed35d50-08a0-4899-99a7-3d368becf985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c67109d-e12e-4fdd-be04-f6092ae04d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c67109d-e12e-4fdd-be04-f6092ae04d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27b0174-e123-483c-882f-8aa09a079164', 'volume_name': 'volume-a27b0174-e123-483c-882f-8aa09a079164', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32cb5d7-eb5c-45fd-a4eb-c4dfd84e0fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32cb5d7-eb5c-45fd-a4eb-c4dfd84e0fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96580c1-dc19-417e-a1c7-ceda29b75ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Volume a27b0174-e123-483c-882f-8aa09a079164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27b0174-e123-483c-882f-8aa09a079164', 'volume_size': 1} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2120995707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27b0174-e123-483c-882f-8aa09a079164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b26f444edd644216848e7a993547a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:54Z,use_quota=True,user_id='311bee7480e14dbf9820ab9fbddc1939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Creating volume a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:02:53 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:02:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:54 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 1073741824 Jun 23 14:02:54 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:55 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 1073741824" returned: 0 in 1.715s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:55 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 Jun 23 14:02:55 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (facf54d7-d8eb-437b-8f4a-de3e1ce12e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b07cea-d9d9-4950-8ae5-2e0953e33af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b07cea-d9d9-4950-8ae5-2e0953e33af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-864112546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbcc569-d0df-45f6-b1a0-90570698e992,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:56Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb9c3b5-d21b-45f7-b09b-a8c88d6eaa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb9c3b5-d21b-45f7-b09b-a8c88d6eaa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc52d1d-ad91-4ad1-8376-44a31181ec03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc52d1d-ad91-4ad1-8376-44a31181ec03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bbcc569-d0df-45f6-b1a0-90570698e992', 'volume_name': 'volume-8bbcc569-d0df-45f6-b1a0-90570698e992', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b67b06-a7c8-4344-bb3d-dd865ddd985e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b67b06-a7c8-4344-bb3d-dd865ddd985e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:56 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3109a1-25b9-40c4-b117-4c885749ab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Volume 8bbcc569-d0df-45f6-b1a0-90570698e992: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bbcc569-d0df-45f6-b1a0-90570698e992', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Trying to clone 8bbcc569-d0df-45f6-b1a0-90570698e992 from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164" returned: 0 in 1.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.874s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96580c1-dc19-417e-a1c7-ceda29b75ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27b0174-e123-483c-882f-8aa09a079164', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d70e64d-4e78-4ab9-bef4-17e4059c154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:02:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Volume volume-a27b0174-e123-483c-882f-8aa09a079164 (a27b0174-e123-483c-882f-8aa09a079164): created successfully Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d70e64d-4e78-4ab9-bef4-17e4059c154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:02:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Flow 'volume_create_manager' (86837f8a-1cf0-4951-b798-31d57dec3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:02:56 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-6d9bd469-e9b8-487b-ae59-8af572e3b874 req-5589069c-8e76-478b-b541-efa27233704c tempest-VolumesSnapshotsTestJSON-510743382 None] Created volume successfully. Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:02:57 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da37ca7-8fc0-4982-a1e5-32ffbd2d7f26]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:57 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD Jun 23 14:02:57 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Creating offline snapshot 6b3dbfcf-79ec-4542-8a22-e26667690e6b of volume a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba314d-faf3-4368-b545-c51f7fd5e95a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:58 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 Jun 23 14:02:58 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:58 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD" returned: 0 in 1.224s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:58 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d is fetched for user 14c68b54062a498caaf7636fa0eca2be. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:02:58 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f057a6a-0545-484f-bd44-e3b20710b6fb]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:02:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:58 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD Jun 23 14:02:58 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:58 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164" returned: 0 in 1.167s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:02:59 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b 1G Jun 23 14:02:59 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:02:59 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 23 14:02:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD" returned: 0 in 0.947s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:02:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:00 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b 1G" returned: 0 in 1.073s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27b0174-e123-483c-882f-8aa09a079164 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:00 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27b0174-e123-483c-882f-8aa09a079164 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b Jun 23 14:03:00 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:00 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27b0174-e123-483c-882f-8aa09a079164 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b" returned: 0 in 0.892s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:00 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b is being set with open permissions: ugo+rw Jun 23 14:03:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:00 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b Jun 23 14:03:00 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:01 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b" returned: 0 in 0.733s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:01 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info Jun 23 14:03:01 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Flow 'volume_create_manager' (98ad2792-5db8-4735-ba18-9575ad099933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50ffbd8-262a-4346-94e4-839637abb31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50ffbd8-262a-4346-94e4-839637abb31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1518668226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1583762c-3cd7-4ecb-8567-ed0d9de2ad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bc07222d994d0394ad5e80a353347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:02Z,use_quota=True,user_id='994528ba66f643ce92112bda9ba6fad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cbfe7c-01bd-4f69-9490-dc0dc36f6119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7cbfe7c-01bd-4f69-9490-dc0dc36f6119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f011299-7e05-42c3-975a-8535939a065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f011299-7e05-42c3-975a-8535939a065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1583762c-3cd7-4ecb-8567-ed0d9de2ad15', 'volume_name': 'volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03810492-8a88-466b-90aa-26d1fbb6e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03810492-8a88-466b-90aa-26d1fbb6e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758c8f3b-ee2e-4c48-a5bb-e822941179d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:02 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Volume 1583762c-3cd7-4ecb-8567-ed0d9de2ad15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15', 'volume_size': 1} Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:02 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info" returned: 0 in 0.820s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:02 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info is being set with open permissions: ugo+rw Jun 23 14:03:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:02 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info Jun 23 14:03:02 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:03 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.info" returned: 0 in 1.126s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.948s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-864112546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbcc569-d0df-45f6-b1a0-90570698e992,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:02:56Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Creating volume 8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:03 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:03 devstack sudo[104564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 1073741824 Jun 23 14:03:03 devstack sudo[104564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-c2f4e7a5-cead-4fc8-91ca-daae9de59fc0 req-9e3ee766-9b49-4ac8-ba01-abf9b05647c9 tempest-VolumesSnapshotsTestJSON-510743382 None] Create snapshot completed successfully Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "cinder-6b3dbfcf-79ec-4542-8a22-e26667690e6b-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-6b3dbfcf-79ec-4542-8a22-e26667690e6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "cinder-quobyte-a27b0174-e123-483c-882f-8aa09a079164" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-quobyte-a27b0174-e123-483c-882f-8aa09a079164" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "cinder-quobyte-6b3dbfcf-79ec-4542-8a22-e26667690e6b" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-quobyte-6b3dbfcf-79ec-4542-8a22-e26667690e6b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Deleting offline snapshot 6b3dbfcf-79ec-4542-8a22-e26667690e6b of volume a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] snapshot_file for this snap is: volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[745df543-8afc-4027-8b34-40c160bda4a9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:04 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b Jun 23 14:03:04 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:05 devstack sudo[104564]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 1073741824" returned: 0 in 1.391s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:05 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:05 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:05 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b" returned: 0 in 1.282s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27b0174-e123-483c-882f-8aa09a079164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:03:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7440cbc-902c-41a6-bbef-6d2aa5208667]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:06 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 Jun 23 14:03:06 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:06 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] <== create_volume: return (2533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.962s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1518668226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1583762c-3cd7-4ecb-8567-ed0d9de2ad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bc07222d994d0394ad5e80a353347d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:02Z,use_quota=True,user_id='994528ba66f643ce92112bda9ba6fad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Creating volume 1583762c-3cd7-4ecb-8567-ed0d9de2ad15 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:06 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:06 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 1073741824 Jun 23 14:03:06 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Attempting download of c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume 8bbcc569-d0df-45f6-b1a0-90570698e992. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc4eec6-c5d5-4db1-b801-e232188cd87c]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:06 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi Jun 23 14:03:06 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-621a3a9b-6762-4f2b-bfe0-599d242594d7 tempest-VolumesActionsTest-116464932 None] Acquiring lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b" by "attach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-621a3a9b-6762-4f2b-bfe0-599d242594d7 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b" acquired by "attach_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:07 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-621a3a9b-6762-4f2b-bfe0-599d242594d7 tempest-VolumesActionsTest-116464932 None] Attaching volume 519ac7f8-a22f-4ba4-965e-3e30c148e36b to instance 06022d53-4515-4f8d-b533-064974bc1a9e at mountpoint /dev/vdb on host None. Jun 23 14:03:07 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-621a3a9b-6762-4f2b-bfe0-599d242594d7 tempest-VolumesActionsTest-116464932 None] Attach volume completed successfully. Jun 23 14:03:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-621a3a9b-6762-4f2b-bfe0-599d242594d7 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b" released by "attach_volume" :: held 0.182s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:07 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164" returned: 0 in 1.791s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:07 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b Jun 23 14:03:07 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6160fceb-39d9-4a2c-a051-85f681fd6b57 tempest-VolumesActionsTest-116464932 None] Acquiring lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-detach_volume" by "detach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6160fceb-39d9-4a2c-a051-85f681fd6b57 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6160fceb-39d9-4a2c-a051-85f681fd6b57 tempest-VolumesActionsTest-116464932 None] Detaching volume 519ac7f8-a22f-4ba4-965e-3e30c148e36b from instance 06022d53-4515-4f8d-b533-064974bc1a9e. Jun 23 14:03:08 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi" returned: 0 in 1.656s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6160fceb-39d9-4a2c-a051-85f681fd6b57 tempest-VolumesActionsTest-116464932 None] Detach volume completed successfully. Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6160fceb-39d9-4a2c-a051-85f681fd6b57 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:08 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 1073741824" returned: 0 in 2.037s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:08 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi Jun 23 14:03:08 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:08 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 Jun 23 14:03:08 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:09 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b" returned: 0 in 1.397s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:09 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b Jun 23 14:03:09 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:09 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi" returned: 1 in 1.367s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_unwm4gqi' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba65868-8ba2-4c00-88a3-c8a22d49be84]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:09 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15" returned: 0 in 1.174s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] <== create_volume: return (3272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.276s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (758c8f3b-ee2e-4c48-a5bb-e822941179d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5339d1c9-72bd-4725-9fbc-8784b92afe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:09 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Volume volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 (1583762c-3cd7-4ecb-8567-ed0d9de2ad15): created successfully Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5339d1c9-72bd-4725-9fbc-8784b92afe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Flow 'volume_create_manager' (98ad2792-5db8-4735-ba18-9575ad099933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-eb7c9c2a-a8f9-4945-955d-a62692b6ef4f tempest-VolumesServicesTestJSON-716905226 None] Created volume successfully. Jun 23 14:03:09 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD Jun 23 14:03:09 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Acquiring lock "cinder-1583762c-3cd7-4ecb-8567-ed0d9de2ad15-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:10 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164.6b3dbfcf-79ec-4542-8a22-e26667690e6b" returned: 0 in 1.425s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Lock "cinder-1583762c-3cd7-4ecb-8567-ed0d9de2ad15-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-quobyte-6b3dbfcf-79ec-4542-8a22-e26667690e6b" released by "_delete_snapshot" :: held 6.144s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-quobyte-a27b0174-e123-483c-882f-8aa09a079164" released by "delete_snapshot" :: held 6.210s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Acquiring lock "cinder-quobyte-1583762c-3cd7-4ecb-8567-ed0d9de2ad15" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Lock "cinder-quobyte-1583762c-3cd7-4ecb-8567-ed0d9de2ad15" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b8af68-7a8b-48f8-9a80-d00d6ae266c3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:10 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD" returned: 0 in 1.357s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d was qcow2, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:10 devstack cinder-volume[93605]: DEBUG cinder.quota [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Created reservations ['545e6c72-5436-4d43-9c51-1565871c1a9f', '8d741ddd-e6b2-4b1e-9de6-1992ab5d9e03', '281597fd-17c1-42c5-a18a-43cee4bc4f74', '81c6bd42-720c-4c5e-b91b-af4449a832b8'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:10 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:10 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Delete snapshot completed successfully. Jun 23 14:03:11 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 Jun 23 14:03:11 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-5aaaab1e-6b34-4133-a7f2-8ca966c829fb req-3ed08680-a4dc-4979-94b0-e5887313014b tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-6b3dbfcf-79ec-4542-8a22-e26667690e6b-delete_snapshot" released by "delete_snapshot" :: held 6.548s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "cinder-a27b0174-e123-483c-882f-8aa09a079164-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-a27b0174-e123-483c-882f-8aa09a079164-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "cinder-quobyte-a27b0174-e123-483c-882f-8aa09a079164" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-quobyte-a27b0174-e123-483c-882f-8aa09a079164" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95bbc1e-d1d2-4744-9e0d-6d97ab664773]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:11 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 Jun 23 14:03:11 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:11 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15" returned: 0 in 1.130s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:11 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15 Jun 23 14:03:11 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:12 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1583762c-3cd7-4ecb-8567-ed0d9de2ad15" returned: 0 in 0.849s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Lock "cinder-quobyte-1583762c-3cd7-4ecb-8567-ed0d9de2ad15" released by "delete_volume" :: held 2.077s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:12 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164" returned: 0 in 1.185s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Created reservations ['8bfe3769-af96-4bd1-9dbc-07693253b91a', '7fc6f3fc-0480-4f32-9b40-0b910c2127b7', '8a9c594e-8b9e-44e5-8b5f-a420125196d9', '0605f219-ca5d-492e-8019-9b7c9afed061'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:13 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164 Jun 23 14:03:13 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:13 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:13 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:13 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a27b0174-e123-483c-882f-8aa09a079164" returned: 0 in 0.931s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-quobyte-a27b0174-e123-483c-882f-8aa09a079164" released by "delete_volume" :: held 2.250s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:13 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 0 in 3.091s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_j5yjods3devstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:03:13 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Converted 112.00 MB image at 36.22 MB/s Jun 23 14:03:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:14 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 1G Jun 23 14:03:14 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG cinder.quota [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Created reservations ['785dba73-cfad-4d2c-9fa5-0ed65ba7385a', '40b5ce43-4a09-40b3-adbe-e316457c31ec', '322d4b33-ee89-4d3e-aab2-8d17e9ae4d97', '913ebd50-69a6-49d7-86da-e44c4693433a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:14 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.999s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Deleted volume successfully. Jun 23 14:03:14 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:14 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1eb4d2d1-4222-4428-bb5f-fa07aaeffdee tempest-VolumesServicesTestJSON-716905226 None] Lock "cinder-1583762c-3cd7-4ecb-8567-ed0d9de2ad15-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:15 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 1G" returned: 0 in 1.024s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:15 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d3df7-e7a9-4373-b646-f8d561732b60]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:15 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.997s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:15 devstack cinder-volume[93605]: DEBUG cinder.manager [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Deleted volume successfully. Jun 23 14:03:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-30d509db-eaf4-44d7-a2f2-6590de363453 req-8cbb2547-abeb-40e4-9215-5b02d0f8ab6d tempest-VolumesSnapshotsTestJSON-510743382 None] Lock "cinder-a27b0174-e123-483c-882f-8aa09a079164-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:15 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:15 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:16 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 0 in 1.104s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:16 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:16 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:17 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 1 in 1.058s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Downloaded image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume 8bbcc569-d0df-45f6-b1a0-90570698e992 successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d for user 14c68b54062a498caaf7636fa0eca2be is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Marking volume 8bbcc569-d0df-45f6-b1a0-90570698e992 as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Copying metadata from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d to 8bbcc569-d0df-45f6-b1a0-90570698e992. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Creating volume glance metadata for volume 8bbcc569-d0df-45f6-b1a0-90570698e992 backed by image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3109a1-25b9-40c4-b117-4c885749ab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbcc569-d0df-45f6-b1a0-90570698e992', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262a7d07-3d40-47af-a70f-0e40721ebed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Volume volume-8bbcc569-d0df-45f6-b1a0-90570698e992 (8bbcc569-d0df-45f6-b1a0-90570698e992): created successfully Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262a7d07-3d40-47af-a70f-0e40721ebed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (facf54d7-d8eb-437b-8f4a-de3e1ce12e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4da961e6-889e-4e49-9129-d77abb5ed330 tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (04cc1056-a06e-4c8a-9ad6-38eb38921f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3766fd4-2533-46eb-9e60-d6f736f7034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3766fd4-2533-46eb-9e60-d6f736f7034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1393758770',display_name='tempest-VolumesGetTest-Volume-1446773702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7e6384-1019-4b6c-9cfe-5085efe1a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:19Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8aa78f-f59a-4cb4-a831-2f78fa1b9cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8aa78f-f59a-4cb4-a831-2f78fa1b9cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822d1a18-f592-4722-8c04-efb117020041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822d1a18-f592-4722-8c04-efb117020041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7e6384-1019-4b6c-9cfe-5085efe1a3a1', 'volume_name': 'volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9b2170-3a9b-4deb-abc0-ca06e0070f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b9b2170-3a9b-4deb-abc0-ca06e0070f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618835b8-8a37-45ca-ae05-ddfddd834f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:19 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Volume bf7e6384-1019-4b6c-9cfe-5085efe1a3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1', 'volume_size': 1} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1393758770',display_name='tempest-VolumesGetTest-Volume-1446773702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7e6384-1019-4b6c-9cfe-5085efe1a3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e2cf3038514e40b9f3ec94551f055c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:19Z,use_quota=True,user_id='14c68b54062a498caaf7636fa0eca2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Creating volume bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:19 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:19 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 1073741824 Jun 23 14:03:19 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:20 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 1073741824" returned: 0 in 1.475s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:20 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 Jun 23 14:03:20 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Flow 'volume_create_manager' (427bdf83-1a8d-4301-96ea-e059f3b18abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7a6a51-b5e2-4f63-b438-994568429be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:21 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1" returned: 0 in 1.054s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] <== create_volume: return (2617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.620s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7a6a51-b5e2-4f63-b438-994568429be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-93124518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194d50a0-bd30-4082-b4c5-3305505a2ecb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a029d956d5af460d9ebb2326ee4a17a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:22Z,use_quota=True,user_id='001a10ce64234e2195311462572918a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edafada9-4070-4e46-a19d-95c253598acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edafada9-4070-4e46-a19d-95c253598acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a59705-50ce-4874-a9b2-1efbde62ce8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a59705-50ce-4874-a9b2-1efbde62ce8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194d50a0-bd30-4082-b4c5-3305505a2ecb', 'volume_name': 'volume-194d50a0-bd30-4082-b4c5-3305505a2ecb', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ab4b5e-6fd0-4e6a-a650-bf4bea2e9ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ab4b5e-6fd0-4e6a-a650-bf4bea2e9ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58edcdf-b676-4ef3-807f-efce98f269ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:21 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Volume 194d50a0-bd30-4082-b4c5-3305505a2ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194d50a0-bd30-4082-b4c5-3305505a2ecb', 'volume_size': 1} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-93124518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194d50a0-bd30-4082-b4c5-3305505a2ecb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a029d956d5af460d9ebb2326ee4a17a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:22Z,use_quota=True,user_id='001a10ce64234e2195311462572918a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Creating volume 194d50a0-bd30-4082-b4c5-3305505a2ecb {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:21 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:21 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb 1073741824 Jun 23 14:03:21 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (618835b8-8a37-45ca-ae05-ddfddd834f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6a47e2-dadc-4ed3-bf43-135c72e299e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:22 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Volume volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 (bf7e6384-1019-4b6c-9cfe-5085efe1a3a1): created successfully Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6a47e2-dadc-4ed3-bf43-135c72e299e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Flow 'volume_create_manager' (04cc1056-a06e-4c8a-9ad6-38eb38921f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:22 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e2386a8f-cb14-40aa-9e32-024f67e0a2ba tempest-VolumesGetTest-819033561 None] Created volume successfully. Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Lock "cinder-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea41a57-cd76-459c-a47e-f4b14ac0bd02]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:22 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 Jun 23 14:03:22 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:23 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb 1073741824" returned: 0 in 1.247s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:23 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb Jun 23 14:03:23 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:23 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1" returned: 0 in 1.219s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:24 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1 Jun 23 14:03:24 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:24 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb" returned: 0 in 0.925s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f58edcdf-b676-4ef3-807f-efce98f269ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194d50a0-bd30-4082-b4c5-3305505a2ecb', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757fce07-f538-46ef-a6d6-4e6ec9e6634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:24 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Volume volume-194d50a0-bd30-4082-b4c5-3305505a2ecb (194d50a0-bd30-4082-b4c5-3305505a2ecb): created successfully Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757fce07-f538-46ef-a6d6-4e6ec9e6634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Flow 'volume_create_manager' (427bdf83-1a8d-4301-96ea-e059f3b18abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-0c8e0cfa-9a8e-4e9b-8c2b-3ecca4b5d97f req-26f2a7b2-9f4b-4501-b4f3-0f2a03d469a6 tempest-VolumesGetTestJSON-1763478803 None] Created volume successfully. Jun 23 14:03:24 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1" returned: 0 in 0.861s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1" released by "delete_volume" :: held 2.154s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:24 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Created reservations ['c42253bc-13eb-48ac-a1b4-247fa9ef009b', '30199b8a-1293-42cc-97c6-af7642b1da42', '7e410fc0-da15-46e4-81ce-520e13db57ba', 'c70eac0a-5760-4f7d-83bc-6460e1f6194d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:25 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:25 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Acquiring lock "cinder-194d50a0-bd30-4082-b4c5-3305505a2ecb-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Lock "cinder-194d50a0-bd30-4082-b4c5-3305505a2ecb-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Acquiring lock "cinder-quobyte-194d50a0-bd30-4082-b4c5-3305505a2ecb" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Lock "cinder-quobyte-194d50a0-bd30-4082-b4c5-3305505a2ecb" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-8bbcc569-d0df-45f6-b1a0-90570698e992-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:26 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.251s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f61f646-9178-4b7f-bc50-e5bce44538e4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Lock "cinder-8bbcc569-d0df-45f6-b1a0-90570698e992-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0bfb6f8e-fc09-4d62-9a81-340a4417e569 tempest-VolumesGetTest-819033561 None] Lock "cinder-bf7e6384-1019-4b6c-9cfe-5085efe1a3a1-delete_volume" released by "delete_volume" :: held 3.773s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Acquiring lock "cinder-quobyte-8bbcc569-d0df-45f6-b1a0-90570698e992" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-8bbcc569-d0df-45f6-b1a0-90570698e992" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:26 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb Jun 23 14:03:26 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c999bcef-9335-4ccf-94d9-2984c9a1e3a5]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:26 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:26 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:27 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb" returned: 0 in 1.380s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:27 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb Jun 23 14:03:27 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:28 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 0 in 1.523s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:28 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:28 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:28 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-194d50a0-bd30-4082-b4c5-3305505a2ecb" returned: 0 in 1.021s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Lock "cinder-quobyte-194d50a0-bd30-4082-b4c5-3305505a2ecb" released by "delete_volume" :: held 2.530s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG cinder.quota [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Created reservations ['fe185c3f-002c-455f-9b6a-304e5138dbd9', '3e8498f6-93c4-4b7e-b673-3dadeb2a0bd6', '98a94b56-2270-4fc1-a719-6cbbafdfbe21', 'd85dbda2-168a-4cab-a426-3e11637ba2dc'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=129,cinder:SELECT=93,cinder:INSERT=40,cinder:DELETE=11 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:03:28 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=110,cinder:UPDATE=124,cinder:INSERT=33,cinder:DELETE=9 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:29 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:29 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:29 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 1 in 1.320s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:03:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:29 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992 Jun 23 14:03:29 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:30 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.091s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG cinder.manager [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Deleted volume successfully. Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-c8d5e2c9-eb90-4dd7-8d9b-f7de6857dbec req-c721f4a9-d43f-4732-9884-f65b2ab97fc4 tempest-VolumesGetTestJSON-1763478803 None] Lock "cinder-194d50a0-bd30-4082-b4c5-3305505a2ecb-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:30 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8bbcc569-d0df-45f6-b1a0-90570698e992" returned: 0 in 1.085s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Lock "cinder-quobyte-8bbcc569-d0df-45f6-b1a0-90570698e992" released by "delete_volume" :: held 4.038s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Created reservations ['4b73d434-ea66-4401-ace3-9b2b371b937d', '6431a921-03b0-493a-923c-e81014a387da', '1821b471-b41e-4e59-9ba6-c9162561b2c5', '478f1334-1b1f-45cb-b0bf-a598de61bf78'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:30 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:30 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:32 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.241s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:32 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Deleted volume successfully. Jun 23 14:03:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-de1cf876-15c1-4210-9db4-8e5c2a1d7e81 tempest-VolumesGetTest-819033561 None] Lock "cinder-8bbcc569-d0df-45f6-b1a0-90570698e992-delete_volume" released by "delete_volume" :: held 5.769s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Flow 'volume_create_manager' (67ff3323-a99c-43da-926b-dfe33ba9ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae391c6-111d-46c5-945f-d23abf3f7f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae391c6-111d-46c5-945f-d23abf3f7f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-558284194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0842186e-48e2-4c7d-b54f-c3bae0e38b5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7e8308e54a6415eb8af0b749dd51cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:36Z,use_quota=True,user_id='edffb805b4e5461e98a92f97cd48b417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651e9827-4776-4560-94e5-0e7c1b5d843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651e9827-4776-4560-94e5-0e7c1b5d843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4821b7b8-55e8-4734-ad23-27b16ddd6b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4821b7b8-55e8-4734-ad23-27b16ddd6b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0842186e-48e2-4c7d-b54f-c3bae0e38b5a', 'volume_name': 'volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c371d3d9-f3c4-4915-a504-49fa0c876c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c371d3d9-f3c4-4915-a504-49fa0c876c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de640ff-40ec-409b-9085-bdc4525610d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Volume 0842186e-48e2-4c7d-b54f-c3bae0e38b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a', 'volume_size': 1} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-558284194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0842186e-48e2-4c7d-b54f-c3bae0e38b5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7e8308e54a6415eb8af0b749dd51cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:36Z,use_quota=True,user_id='edffb805b4e5461e98a92f97cd48b417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Creating volume 0842186e-48e2-4c7d-b54f-c3bae0e38b5a {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:36 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:36 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a 1073741824 Jun 23 14:03:36 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Flow 'volume_create_manager' (fc488e10-83a1-4b3d-9094-028c72ddd042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860e26e9-00c6-4dc3-877c-0cb61fade38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860e26e9-00c6-4dc3-877c-0cb61fade38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1046041352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c310e409-d8e3-4daf-8518-75477075a957,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf56970a63894d599b613d1f03dd1da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:37Z,use_quota=True,user_id='8a6c1d9c93bf47e1b9f375a45f5deb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351415fa-cd99-4903-8f12-f2d8bdb36953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351415fa-cd99-4903-8f12-f2d8bdb36953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1779ff6f-f24d-4370-bad1-ba950aed7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1779ff6f-f24d-4370-bad1-ba950aed7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c310e409-d8e3-4daf-8518-75477075a957', 'volume_name': 'volume-c310e409-d8e3-4daf-8518-75477075a957', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85349424-6454-4062-9a61-c2ea932ddfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85349424-6454-4062-9a61-c2ea932ddfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72309590-1b51-44c8-bda3-f64f4f9ed458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:36 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Volume c310e409-d8e3-4daf-8518-75477075a957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c310e409-d8e3-4daf-8518-75477075a957', 'volume_size': 1} Jun 23 14:03:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:37 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a 1073741824" returned: 0 in 1.494s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:37 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a Jun 23 14:03:37 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:39 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a" returned: 0 in 1.275s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] <== create_volume: return (2885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.888s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.309s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1046041352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c310e409-d8e3-4daf-8518-75477075a957,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf56970a63894d599b613d1f03dd1da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:37Z,use_quota=True,user_id='8a6c1d9c93bf47e1b9f375a45f5deb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Creating volume c310e409-d8e3-4daf-8518-75477075a957 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:39 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:39 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 1073741824 Jun 23 14:03:39 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de640ff-40ec-409b-9085-bdc4525610d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df56e21-d034-4b90-9553-a23994bba633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:39 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Volume volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a (0842186e-48e2-4c7d-b54f-c3bae0e38b5a): created successfully Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df56e21-d034-4b90-9553-a23994bba633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Flow 'volume_create_manager' (67ff3323-a99c-43da-926b-dfe33ba9ecae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-657596b7-7b0d-47c9-803a-53ef5be78279 tempest-VolumesListTestJSON-1997913106 None] Created volume successfully. Jun 23 14:03:41 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 1073741824" returned: 0 in 1.773s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:41 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 Jun 23 14:03:41 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Flow 'volume_create_manager' (f520fee3-c9b3-4860-a738-04c195aea1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03feb095-714b-4354-bb31-12d7a1b278ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03feb095-714b-4354-bb31-12d7a1b278ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1380321150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e057c94b-3d6b-4cf9-bccc-120de81bc630,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7e8308e54a6415eb8af0b749dd51cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:42Z,use_quota=True,user_id='edffb805b4e5461e98a92f97cd48b417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1925d04c-ebcb-4d46-9505-b917d17d98b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1925d04c-ebcb-4d46-9505-b917d17d98b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a14d82-a3b2-4628-9a4b-7402a8539444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a14d82-a3b2-4628-9a4b-7402a8539444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e057c94b-3d6b-4cf9-bccc-120de81bc630', 'volume_name': 'volume-e057c94b-3d6b-4cf9-bccc-120de81bc630', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387bb3fb-8a29-43bd-a057-dc1b777ffe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387bb3fb-8a29-43bd-a057-dc1b777ffe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde4290e-6bc3-4ece-b13d-f671c6004e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:42 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Volume e057c94b-3d6b-4cf9-bccc-120de81bc630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e057c94b-3d6b-4cf9-bccc-120de81bc630', 'volume_size': 1} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:42 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957" returned: 0 in 0.957s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] <== create_volume: return (2871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.875s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1380321150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e057c94b-3d6b-4cf9-bccc-120de81bc630,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7e8308e54a6415eb8af0b749dd51cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:42Z,use_quota=True,user_id='edffb805b4e5461e98a92f97cd48b417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Creating volume e057c94b-3d6b-4cf9-bccc-120de81bc630 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:42 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72309590-1b51-44c8-bda3-f64f4f9ed458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c310e409-d8e3-4daf-8518-75477075a957', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:42 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 1073741824 Jun 23 14:03:42 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510512f7-4833-4cdd-ab5c-d4fd9f770bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:42 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Volume volume-c310e409-d8e3-4daf-8518-75477075a957 (c310e409-d8e3-4daf-8518-75477075a957): created successfully Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510512f7-4833-4cdd-ab5c-d4fd9f770bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Flow 'volume_create_manager' (fc488e10-83a1-4b3d-9094-028c72ddd042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9e2c2f49-199f-4919-a1fc-7c473133a8de tempest-VolumesTestJSON-225760297 None] Created volume successfully. Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-460580ee-c393-4599-8914-6b012be8e53a tempest-VolumesActionsTest-116464932 None] Acquiring lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b" by "attach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-460580ee-c393-4599-8914-6b012be8e53a tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b" acquired by "attach_volume" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-460580ee-c393-4599-8914-6b012be8e53a tempest-VolumesActionsTest-116464932 None] Attaching volume 519ac7f8-a22f-4ba4-965e-3e30c148e36b to instance 555fc59f-b86a-4838-8e0c-2d4112d95a48 at mountpoint /dev/vdb on host None. Jun 23 14:03:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-460580ee-c393-4599-8914-6b012be8e53a tempest-VolumesActionsTest-116464932 None] Attach volume completed successfully. Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-460580ee-c393-4599-8914-6b012be8e53a tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b" released by "attach_volume" :: held 0.190s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Flow 'volume_create_manager' (c778767a-f8ca-4f3d-ab50-3cf14a328bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87293288-cce7-40a1-a4b5-66814eb1f730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87293288-cce7-40a1-a4b5-66814eb1f730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1363011484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3dc220-f390-4b88-8321-d89d6c27192c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf56970a63894d599b613d1f03dd1da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:44Z,use_quota=True,user_id='8a6c1d9c93bf47e1b9f375a45f5deb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e0713e-cdb3-4f44-9d08-36feeb05b2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e0713e-cdb3-4f44-9d08-36feeb05b2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3c421-d67b-4d16-8ef8-b24d52e0dead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3c421-d67b-4d16-8ef8-b24d52e0dead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3dc220-f390-4b88-8321-d89d6c27192c', 'volume_name': 'volume-2c3dc220-f390-4b88-8321-d89d6c27192c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e351a70-56e6-4e37-85b5-ff6b22e8a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e351a70-56e6-4e37-85b5-ff6b22e8a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cca6602-b2bc-4747-9c88-a6ece1e314c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Volume 2c3dc220-f390-4b88-8321-d89d6c27192c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3dc220-f390-4b88-8321-d89d6c27192c', 'volume_size': 1} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0608df0b-e79e-4982-badf-19689a52eb01 tempest-VolumesActionsTest-116464932 None] Acquiring lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-detach_volume" by "detach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0608df0b-e79e-4982-badf-19689a52eb01 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0608df0b-e79e-4982-badf-19689a52eb01 tempest-VolumesActionsTest-116464932 None] Detaching volume 519ac7f8-a22f-4ba4-965e-3e30c148e36b from instance 555fc59f-b86a-4838-8e0c-2d4112d95a48. Jun 23 14:03:43 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 1073741824" returned: 0 in 1.866s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0608df0b-e79e-4982-badf-19689a52eb01 tempest-VolumesActionsTest-116464932 None] Detach volume completed successfully. Jun 23 14:03:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0608df0b-e79e-4982-badf-19689a52eb01 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:44 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 Jun 23 14:03:44 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:45 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630" returned: 0 in 0.988s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] <== create_volume: return (2928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.935s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1363011484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3dc220-f390-4b88-8321-d89d6c27192c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf56970a63894d599b613d1f03dd1da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:44Z,use_quota=True,user_id='8a6c1d9c93bf47e1b9f375a45f5deb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Creating volume 2c3dc220-f390-4b88-8321-d89d6c27192c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:45 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde4290e-6bc3-4ece-b13d-f671c6004e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e057c94b-3d6b-4cf9-bccc-120de81bc630', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d85e043-1aa7-4c7f-a7a5-8706fa0c5842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:45 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Volume volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 (e057c94b-3d6b-4cf9-bccc-120de81bc630): created successfully Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d85e043-1aa7-4c7f-a7a5-8706fa0c5842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Flow 'volume_create_manager' (f520fee3-c9b3-4860-a738-04c195aea1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:45 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c 1073741824 Jun 23 14:03:45 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:45 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-edc98245-5848-4688-b95a-bfbdab581272 tempest-VolumesListTestJSON-1997913106 None] Created volume successfully. Jun 23 14:03:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c 1073741824" returned: 0 in 1.697s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:46 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:46 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c Jun 23 14:03:47 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Flow 'volume_create_manager' (6dd90332-d9b2-46dc-8710-90e2332bcea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c14c6b-22d1-4ed2-b08c-d37b127bc350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c14c6b-22d1-4ed2-b08c-d37b127bc350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1923503002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bba1e7-95ea-4961-981e-5dd222b39bd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7e8308e54a6415eb8af0b749dd51cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:47Z,use_quota=True,user_id='edffb805b4e5461e98a92f97cd48b417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45e3be0-fcd6-4d1f-84cf-e22245d32829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45e3be0-fcd6-4d1f-84cf-e22245d32829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f313ef30-78b6-48c4-8db5-1c339e225979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f313ef30-78b6-48c4-8db5-1c339e225979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1bba1e7-95ea-4961-981e-5dd222b39bd3', 'volume_name': 'volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1712ed-fc2a-4b61-8160-f8dcccbf28f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1712ed-fc2a-4b61-8160-f8dcccbf28f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40725d6b-dd35-4ac7-8abe-c9323d623069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:47 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Volume b1bba1e7-95ea-4961-981e-5dd222b39bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3', 'volume_size': 1} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:47 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c" returned: 0 in 0.981s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] <== create_volume: return (2836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.858s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1923503002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bba1e7-95ea-4961-981e-5dd222b39bd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7e8308e54a6415eb8af0b749dd51cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:47Z,use_quota=True,user_id='edffb805b4e5461e98a92f97cd48b417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Creating volume b1bba1e7-95ea-4961-981e-5dd222b39bd3 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:47 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:47 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 1073741824 Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cca6602-b2bc-4747-9c88-a6ece1e314c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3dc220-f390-4b88-8321-d89d6c27192c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:47 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfca2d3-2d07-4460-ba0a-1e8188ac68d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:48 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Volume volume-2c3dc220-f390-4b88-8321-d89d6c27192c (2c3dc220-f390-4b88-8321-d89d6c27192c): created successfully Jun 23 14:03:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfca2d3-2d07-4460-ba0a-1e8188ac68d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Flow 'volume_create_manager' (c778767a-f8ca-4f3d-ab50-3cf14a328bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-82e96f9e-64ae-4cf0-a6d2-9e271b8cb85f tempest-VolumesTestJSON-225760297 None] Created volume successfully. Jun 23 14:03:49 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 1073741824" returned: 0 in 1.521s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:49 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 Jun 23 14:03:49 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Flow 'volume_create_manager' (db2ce587-9604-4ae8-8e8f-fdb18d771a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f8f5bf-b17d-443c-b3e5-3fc6683fa530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f8f5bf-b17d-443c-b3e5-3fc6683fa530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-740514122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40d1cbc-eeba-467e-9f83-10338573db6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf56970a63894d599b613d1f03dd1da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:50Z,use_quota=True,user_id='8a6c1d9c93bf47e1b9f375a45f5deb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e8e74-5b62-4d15-b8a7-ec901511f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e8e74-5b62-4d15-b8a7-ec901511f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6958646a-9b7f-4351-bf11-db82b79981cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6958646a-9b7f-4351-bf11-db82b79981cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40d1cbc-eeba-467e-9f83-10338573db6b', 'volume_name': 'volume-b40d1cbc-eeba-467e-9f83-10338573db6b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dd2f3c-a8c5-40ad-a876-0ac64c3c988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dd2f3c-a8c5-40ad-a876-0ac64c3c988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca977dc-cd94-4cbd-acc5-e162ef436c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:49 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Volume b40d1cbc-eeba-467e-9f83-10338573db6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40d1cbc-eeba-467e-9f83-10338573db6b', 'volume_size': 1} Jun 23 14:03:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:50 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3" returned: 0 in 0.905s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-740514122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40d1cbc-eeba-467e-9f83-10338573db6b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf56970a63894d599b613d1f03dd1da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:03:50Z,use_quota=True,user_id='8a6c1d9c93bf47e1b9f375a45f5deb29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Creating volume b40d1cbc-eeba-467e-9f83-10338573db6b {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:03:50 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40725d6b-dd35-4ac7-8abe-c9323d623069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a389d69-1095-497d-a906-ce63f652353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:50 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b 1073741824 Jun 23 14:03:50 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:50 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Volume volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 (b1bba1e7-95ea-4961-981e-5dd222b39bd3): created successfully Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a389d69-1095-497d-a906-ce63f652353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Flow 'volume_create_manager' (6dd90332-d9b2-46dc-8710-90e2332bcea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d884917a-48f7-4d32-ad99-435446e70f55 tempest-VolumesListTestJSON-1997913106 None] Created volume successfully. Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:51 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:51 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:51 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b 1073741824" returned: 0 in 1.351s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:51 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b Jun 23 14:03:51 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:52 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.312s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:03:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:03:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:03:53 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b" returned: 0 in 1.172s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] <== create_volume: return (2650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.653s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca977dc-cd94-4cbd-acc5-e162ef436c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40d1cbc-eeba-467e-9f83-10338573db6b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c521ae88-a57d-4775-91f2-645c58024184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:03:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Volume volume-b40d1cbc-eeba-467e-9f83-10338573db6b (b40d1cbc-eeba-467e-9f83-10338573db6b): created successfully Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c521ae88-a57d-4775-91f2-645c58024184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:03:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Flow 'volume_create_manager' (db2ce587-9604-4ae8-8e8f-fdb18d771a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:03:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0ef78937-0eea-4c9b-a9b4-600bc622c623 tempest-VolumesTestJSON-225760297 None] Created volume successfully. Jun 23 14:03:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "cinder-b1bba1e7-95ea-4961-981e-5dd222b39bd3-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-b1bba1e7-95ea-4961-981e-5dd222b39bd3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "cinder-quobyte-b1bba1e7-95ea-4961-981e-5dd222b39bd3" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-quobyte-b1bba1e7-95ea-4961-981e-5dd222b39bd3" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e007e-8661-423a-b34f-652fef2a14a7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:55 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 Jun 23 14:03:55 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e519a-fbb0-4ad0-815c-78bdd991a57a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:55 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:03:55 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Acquiring lock "cinder-b40d1cbc-eeba-467e-9f83-10338573db6b-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Lock "cinder-b40d1cbc-eeba-467e-9f83-10338573db6b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Acquiring lock "cinder-quobyte-b40d1cbc-eeba-467e-9f83-10338573db6b" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Lock "cinder-quobyte-b40d1cbc-eeba-467e-9f83-10338573db6b" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[449ba4e5-7973-413e-a914-0bc126e44a02]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:56 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3" returned: 0 in 1.129s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:56 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3 Jun 23 14:03:56 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:56 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b Jun 23 14:03:56 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:56 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 1.246s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53aa2c-c229-45be-b955-33a3e31c3e7a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:56 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:03:56 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:57 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b" returned: 0 in 1.177s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:57 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b Jun 23 14:03:57 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:57 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b1bba1e7-95ea-4961-981e-5dd222b39bd3" returned: 0 in 1.159s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-quobyte-b1bba1e7-95ea-4961-981e-5dd222b39bd3" released by "delete_volume" :: held 2.350s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Created reservations ['9d730a50-646d-4943-9bb4-2cf6157d280e', '6b6eefab-7c85-4fe4-bf9f-db77dbba283c', '889a3a55-6c6f-401c-ae4e-89f02247f3e0', '1dec554d-0368-483c-b0b9-47e911389ccf'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:57 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:57 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:57 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 1.403s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.7b81235d-8bb8-4ce5-98c5-12e92c0c2373cm84muwn.img {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:58 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.7b81235d-8bb8-4ce5-98c5-12e92c0c2373cm84muwn.img Jun 23 14:03:58 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:58 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b40d1cbc-eeba-467e-9f83-10338573db6b" returned: 0 in 1.018s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Lock "cinder-quobyte-b40d1cbc-eeba-467e-9f83-10338573db6b" released by "delete_volume" :: held 2.276s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Created reservations ['125431b7-11f6-40c8-9d87-531c76f82a75', '332508c2-40ad-406a-ba3f-401b8c2c67a0', '43417394-451b-4898-af36-3f6007c4ba80', '2abb58ba-6812-427f-afce-d3bc60d85800'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:03:58 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.975s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "cinder-e057c94b-3d6b-4cf9-bccc-120de81bc630-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Deleted volume successfully. Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-e057c94b-3d6b-4cf9-bccc-120de81bc630-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:58 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:03:58 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8c887f01-e29d-4a36-80b5-28454a6d75a4 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-b1bba1e7-95ea-4961-981e-5dd222b39bd3-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "cinder-quobyte-e057c94b-3d6b-4cf9-bccc-120de81bc630" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-quobyte-e057c94b-3d6b-4cf9-bccc-120de81bc630" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[971db269-c113-4914-98d0-ab06ee097066]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:03:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:03:59 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 Jun 23 14:03:59 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:03:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Acquiring lock "cinder-2c3dc220-f390-4b88-8321-d89d6c27192c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:03:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Lock "cinder-2c3dc220-f390-4b88-8321-d89d6c27192c-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:03:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Acquiring lock "cinder-quobyte-2c3dc220-f390-4b88-8321-d89d6c27192c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Lock "cinder-quobyte-2c3dc220-f390-4b88-8321-d89d6c27192c" acquired by "delete_volume" :: waited 0.046s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:00 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ebcf21-1e02-41b9-afe2-648dce3a5008]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:00 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c Jun 23 14:04:00 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:01 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 2.806s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:01 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Deleted volume successfully. Jun 23 14:04:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c57d193-0ac3-4fac-9122-18137d33d6f8 tempest-VolumesTestJSON-225760297 None] Lock "cinder-b40d1cbc-eeba-467e-9f83-10338573db6b-delete_volume" released by "delete_volume" :: held 5.606s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:01 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630" returned: 0 in 2.977s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:01 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630 Jun 23 14:04:01 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:03 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e057c94b-3d6b-4cf9-bccc-120de81bc630" returned: 0 in 1.543s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-quobyte-e057c94b-3d6b-4cf9-bccc-120de81bc630" released by "delete_volume" :: held 4.630s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:03 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c" returned: 0 in 3.314s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:03 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c Jun 23 14:04:03 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Created reservations ['bba45f27-503e-4c13-a719-24f02835fb0c', 'a2a11b61-c71e-463b-be2c-b1cdaeb151ee', '082e25f0-ccae-4bf7-b949-a0b7ddf447d5', '6f5ead03-c302-4735-8fce-9f4e6e759163'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:04 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:04:04 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "cinder-0842186e-48e2-4c7d-b54f-c3bae0e38b5a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-0842186e-48e2-4c7d-b54f-c3bae0e38b5a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:05 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "cinder-quobyte-0842186e-48e2-4c7d-b54f-c3bae0e38b5a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2c3dc220-f390-4b88-8321-d89d6c27192c" returned: 0 in 1.961s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Lock "cinder-quobyte-2c3dc220-f390-4b88-8321-d89d6c27192c" released by "delete_volume" :: held 5.420s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-quobyte-0842186e-48e2-4c7d-b54f-c3bae0e38b5a" acquired by "delete_volume" :: waited 0.053s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:05 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.7b81235d-8bb8-4ce5-98c5-12e92c0c2373cm84muwn.img" returned: 0 in 7.526s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b940720c-b6b6-447b-8f82-14c4778516a4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2efd61-7990-44b7-a1ac-c6e1f9e0f0d5]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Created reservations ['9b143a1f-ff2f-4a24-9ed7-d105886aaf17', '3acb2da7-e4fc-48f4-b8cc-79eb017248f1', '2ae02e53-da36-49a6-93dd-5751e92779f5', '07a9966e-b29e-4ecc-b00d-045e6f6855c8'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:05 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.654s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Deleted volume successfully. Jun 23 14:04:05 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a Jun 23 14:04:05 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec524612-4720-4c6d-98e6-66b86cab2641 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-e057c94b-3d6b-4cf9-bccc-120de81bc630-delete_volume" released by "delete_volume" :: held 7.088s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:05 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:04:05 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:05 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:04:05 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Acquiring lock "cinder-c310e409-d8e3-4daf-8518-75477075a957-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Lock "cinder-c310e409-d8e3-4daf-8518-75477075a957-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Acquiring lock "cinder-quobyte-c310e409-d8e3-4daf-8518-75477075a957" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Lock "cinder-quobyte-c310e409-d8e3-4daf-8518-75477075a957" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d04969-834b-4f9b-97c8-1c1c1f8c9353]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:06 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 Jun 23 14:04:06 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:06 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a" returned: 0 in 1.341s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:06 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a Jun 23 14:04:06 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:06 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.089s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:06 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Deleted volume successfully. Jun 23 14:04:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-03f77bf3-4983-477b-9989-15d8576be3ef tempest-VolumesTestJSON-225760297 None] Lock "cinder-2c3dc220-f390-4b88-8321-d89d6c27192c-delete_volume" released by "delete_volume" :: held 7.182s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:07 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 1.673s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.7b81235d-8bb8-4ce5-98c5-12e92c0c2373cm84muwn.img {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:04:07 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Converted 1024.00 MB image at 135.99 MB/s Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] 7b81235d-8bb8-4ce5-98c5-12e92c0c2373 was raw, no need to convert to raw {{(pid=93605) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 14:04:07 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0842186e-48e2-4c7d-b54f-c3bae0e38b5a" returned: 0 in 0.966s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-quobyte-0842186e-48e2-4c7d-b54f-c3bae0e38b5a" released by "delete_volume" :: held 2.374s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Created reservations ['b0caac4d-b8d5-4368-9401-c17695f5cbcf', '2658c36b-f828-4f98-8062-6bbe029a2d95', '1def8b1b-f2f3-45e1-9e8b-7542848552a3', '58c6c66a-f086-457d-9c88-e7d54a34b8e8'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:07 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957" returned: 0 in 1.395s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:07 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957 Jun 23 14:04:07 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:08 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:04:08 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:08 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c310e409-d8e3-4daf-8518-75477075a957" returned: 0 in 1.054s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:08 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.918s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Lock "cinder-quobyte-c310e409-d8e3-4daf-8518-75477075a957" released by "delete_volume" :: held 2.549s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Deleted volume successfully. Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d17d10d4-cc9e-479c-9534-a814ae70f202 tempest-VolumesListTestJSON-1997913106 None] Lock "cinder-0842186e-48e2-4c7d-b54f-c3bae0e38b5a-delete_volume" released by "delete_volume" :: held 3.728s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Created reservations ['89bdff8c-f6b0-4ac9-8d8b-3f5e68995696', '60387aeb-67d9-4510-87ee-aea686ff779b', '7638a18f-0580-41ba-a022-84c8a43479e2', '590e5297-0469-4094-9f25-a3496a5adb5f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:09 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:04:09 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:10 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.024s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:10 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:10 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Deleted volume successfully. Jun 23 14:04:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ede9b882-c0e8-4eec-ba2f-724ced38b4ae tempest-VolumesTestJSON-225760297 None] Lock "cinder-c310e409-d8e3-4daf-8518-75477075a957-delete_volume" released by "delete_volume" :: held 4.071s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:04:18 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f09632d-e5bc-4fab-b28a-88fa6df505cd tempest-GroupSnapshotsTest-1328288680 None] Group tempest-GroupSnapshotsTest-Group-365573552: creating Jun 23 14:04:18 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f09632d-e5bc-4fab-b28a-88fa6df505cd tempest-GroupSnapshotsTest-1328288680 None] Group tempest-GroupSnapshotsTest-Group-365573552: created successfully Jun 23 14:04:18 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f09632d-e5bc-4fab-b28a-88fa6df505cd tempest-GroupSnapshotsTest-1328288680 None] Create group completed successfully. Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (60c6b366-077c-4fca-b79c-3f2717092f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a5e0f7-ac3e-43e5-b292-e7f67f84e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a5e0f7-ac3e-43e5-b292-e7f67f84e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352899731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2b95f47-c7b5-4b00-831c-35462874515e,host='devstack@QuobyteHD#QuobyteHD',id=6d3dcf28-005e-4b3b-9938-d04cba6c8d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:20Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557c61ca-e2ca-4159-accf-09342e1a8f9a),volume_type_id=557c61ca-e2ca-4159-accf-09342e1a8f9a)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208516a4-4259-47a2-a7bb-7b9a46788ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208516a4-4259-47a2-a7bb-7b9a46788ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead9feb9-5eef-40d4-8d26-b0d67ecb9747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead9feb9-5eef-40d4-8d26-b0d67ecb9747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3dcf28-005e-4b3b-9938-d04cba6c8d37', 'volume_name': 'volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5738f7ec-1eee-4688-9332-bab727d0b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5738f7ec-1eee-4688-9332-bab727d0b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7f17de-d196-40bd-bfb0-badba4584b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:20 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Volume 6d3dcf28-005e-4b3b-9938-d04cba6c8d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37', 'volume_size': 1} Jun 23 14:04:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:30 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=72,cinder:DELETE=8,cinder:SELECT=55,cinder:INSERT=17 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:04:30 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=96,cinder:SELECT=62,cinder:INSERT=19,cinder:DELETE=6 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (d1e188df-7d4d-47a5-87fd-35b7a73eba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c480ffb4-c724-4087-aaa7-d19eecd0e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c480ffb4-c724-4087-aaa7-d19eecd0e194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961127491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:34Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7eb2ac-e8e9-4cca-a6cf-ec0ca79906cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7eb2ac-e8e9-4cca-a6cf-ec0ca79906cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb68501-5945-4a38-9e19-81e2e6656412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb68501-5945-4a38-9e19-81e2e6656412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba', 'volume_name': 'volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7d275d-71fc-4f1b-b23b-80e367775fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7d275d-71fc-4f1b-b23b-80e367775fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e82490f-e3ac-4eb4-b96f-bbad64907dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:34 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume 3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba', 'volume_size': 1} Jun 23 14:04:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.648s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Uploaded volume to glance image-id: 7b81235d-8bb8-4ce5-98c5-12e92c0c2373. {{(pid=93605) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.482s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2b95f47-c7b5-4b00-831c-35462874515e,created_at=2026-06-23T12:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1352899731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2b95f47-c7b5-4b00-831c-35462874515e,host='devstack@QuobyteHD#QuobyteHD',id=6d3dcf28-005e-4b3b-9938-d04cba6c8d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:20Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(557c61ca-e2ca-4159-accf-09342e1a8f9a),volume_type_id=557c61ca-e2ca-4159-accf-09342e1a8f9a)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Creating volume 6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:38 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:04:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:38 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 1073741824 Jun 23 14:04:38 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f092e451-4d0e-43b9-a7d6-3aa7f7f1291a tempest-VolumesActionsTest-116464932 None] Copy volume to image completed successfully. Jun 23 14:04:40 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 1073741824" returned: 0 in 1.141s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:40 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:04:40 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:40 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 0.758s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.690s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961127491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:34Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating volume 3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:04:40 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:40 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba 1073741824 Jun 23 14:04:40 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7f17de-d196-40bd-bfb0-badba4584b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4990324a-701a-469a-b2fe-fc482abd3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:40 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Volume volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 (6d3dcf28-005e-4b3b-9938-d04cba6c8d37): created successfully Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4990324a-701a-469a-b2fe-fc482abd3aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (60c6b366-077c-4fca-b79c-3f2717092f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-17982944-9abd-4e8b-a8b4-cbcfa87afd9d tempest-GroupSnapshotsTest-1328288680 None] Created volume successfully. Jun 23 14:04:41 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] GroupSnapshot b6dad147-71eb-4ce4-81c7-62de306acdbf: creating. Jun 23 14:04:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Group snapshot b6dad147-71eb-4ce4-81c7-62de306acdbf: creating. {{(pid=93605) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:04:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:42 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba 1073741824" returned: 0 in 1.701s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:42 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba Jun 23 14:04:42 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:43 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" returned: 0 in 0.782s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.903s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e82490f-e3ac-4eb4-b96f-bbad64907dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a6380a-26a6-496f-baa8-c4da8dbd114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72ec3b-11b5-4d19-a500-9ce1ea4bf0fd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba (3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba): created successfully Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a6380a-26a6-496f-baa8-c4da8dbd114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (d1e188df-7d4d-47a5-87fd-35b7a73eba07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-aaf4876a-424f-4448-b387-c24570a4b3b8 tempest-VolumesSnapshotTestJSON-1451537270 None] Created volume successfully. Jun 23 14:04:43 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:04:43 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:44 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 1.040s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619f6fe-5336-494d-ae42-668837927fb6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:44 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:04:44 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:45 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 1.093s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:45 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img Jun 23 14:04:45 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (e6351f2f-c85a-4998-a451-e1134258764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf70a99b-e34e-4649-a7a5-98f2364c438b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf70a99b-e34e-4649-a7a5-98f2364c438b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-336284168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f58665-bf56-4908-8dcc-2f30e4301ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:46Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40eea5a-c8f0-4be7-ac60-4c24879ce542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40eea5a-c8f0-4be7-ac60-4c24879ce542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5be75e-8d96-4910-86eb-a0da4503189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5be75e-8d96-4910-86eb-a0da4503189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90f58665-bf56-4908-8dcc-2f30e4301ab1', 'volume_name': 'volume-90f58665-bf56-4908-8dcc-2f30e4301ab1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55e13ad-2b61-40a7-b082-1edafd523d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55e13ad-2b61-40a7-b082-1edafd523d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb36938-2f2a-4f61-8d5a-c96936d4a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:04:46 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Volume 90f58665-bf56-4908-8dcc-2f30e4301ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90f58665-bf56-4908-8dcc-2f30e4301ab1', 'volume_size': 1} Jun 23 14:04:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:51 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img" returned: 0 in 5.708s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e834e-d336-4504-bc71-689653ef3966]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:51 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:04:51 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:51 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:04:51 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:52 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 1.087s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:04:52 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Converted 1024.00 MB image at 179.38 MB/s Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] b543691a-18a0-4959-8b54-238eb70a90a0 was raw, converting to qcow2 {{(pid=93605) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[315fa7e0-e14d-4848-af45-d113573d65df]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:52 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.895s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:04:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:04:52 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img Jun 23 14:04:52 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:53 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img" returned: 0 in 0.909s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:53 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img Jun 23 14:04:53 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:54 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img" returned: 1 in 0.843s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:04:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img /opt/stack/data/cinder/conversion/vol_upload_84avj96t {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:54 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img /opt/stack/data/cinder/conversion/vol_upload_84avj96t Jun 23 14:04:54 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:55 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img /opt/stack/data/cinder/conversion/vol_upload_84avj96t" returned: 0 in 0.746s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:55 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Image conversion details: src /opt/stack/data/cinder/conversion/519ac7f8-a22f-4ba4-965e-3e30c148e36b.temp_image.b543691a-18a0-4959-8b54-238eb70a90a04iknqe3o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_84avj96t {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:04:55 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 14:04:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1f975-7a0e-4542-aa46-9a410a322fa5]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_84avj96t {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:55 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_84avj96t Jun 23 14:04:55 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:55 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_84avj96t" returned: 0 in 0.781s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:56 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:04:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.178s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:04:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Uploaded volume to glance image-id: b543691a-18a0-4959-8b54-238eb70a90a0. {{(pid=93605) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 14:04:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.865s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:04:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Creating offline snapshot 82b84ed5-dd9f-43df-bc0f-916b1ae6869a of volume 6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:04:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-bd9da845-d2ba-4fbf-a887-5493802ec1df tempest-VolumesActionsTest-116464932 None] Copy volume to image completed successfully. Jun 23 14:04:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e4099-b5d7-4be3-a5dd-4a8ec4ec9d5a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:57 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:04:57 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:58 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 0.881s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:58 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a 1G Jun 23 14:04:58 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Acquiring lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Acquiring lock "cinder-quobyte-519ac7f8-a22f-4ba4-965e-3e30c148e36b" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Lock "cinder-quobyte-519ac7f8-a22f-4ba4-965e-3e30c148e36b" acquired by "delete_volume" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90b9f43-5822-49d7-8752-1fe2b7280188]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:59 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a 1G" returned: 0 in 0.968s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:04:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:04:59 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a Jun 23 14:04:59 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:04:59 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:04:59 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:00 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:00 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:05:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:00 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a Jun 23 14:05:00 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:00 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 0.890s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:00 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b Jun 23 14:05:00 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:01 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a" returned: 0 in 0.749s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:01 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info Jun 23 14:05:01 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:01 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-519ac7f8-a22f-4ba4-965e-3e30c148e36b" returned: 0 in 0.775s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Lock "cinder-quobyte-519ac7f8-a22f-4ba4-965e-3e30c148e36b" released by "delete_volume" :: held 1.717s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Created reservations ['b9d88cb9-0f01-45a3-a6e3-f609fb5ce6d0', 'de941dbe-eaf7-4148-97dd-86869f8d3280', 'ff851c3b-130f-426b-9ad8-4fd557b24a75', 'c3ee2c74-31e7-45ba-8881-6331735be464'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:01 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:01 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:01 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info" returned: 0 in 0.784s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:01 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:05:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:01 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info Jun 23 14:05:01 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:02 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.809s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Deleted volume successfully. Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a7c1e74-06e1-437c-adea-517efe507580 tempest-VolumesActionsTest-116464932 None] Lock "cinder-519ac7f8-a22f-4ba4-965e-3e30c148e36b-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:02 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.info" returned: 0 in 0.811s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.124s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.578s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating offline snapshot 9c6d45f3-3310-41ff-a7dd-0863c3dd555a of volume 3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c17f618-14d3-4455-8dfb-e027c398f049]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-aac067fb-7ec3-4bc2-b1e3-76e638c4a467 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot b6dad147-71eb-4ce4-81c7-62de306acdbf: created successfully Jun 23 14:05:02 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba Jun 23 14:05:02 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:03 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" returned: 0 in 1.029s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:03 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a 1G Jun 23 14:05:03 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:05 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a 1G" returned: 0 in 1.164s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:05 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a Jun 23 14:05:05 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:06 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a" returned: 0 in 1.249s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:06 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a is being set with open permissions: ugo+rw Jun 23 14:05:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:06 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a Jun 23 14:05:06 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:07 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a" returned: 0 in 0.866s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:07 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info Jun 23 14:05:07 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:08 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info" returned: 0 in 0.974s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:08 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info is being set with open permissions: ugo+rw Jun 23 14:05:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:08 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info Jun 23 14:05:08 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:09 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.info" returned: 0 in 0.860s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.287s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.836s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-336284168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f58665-bf56-4908-8dcc-2f30e4301ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:04:46Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Creating volume 90f58665-bf56-4908-8dcc-2f30e4301ab1 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:09 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:09 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 1073741824 Jun 23 14:05:09 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-11a4427a-7c44-4a42-bb1a-b13fd71bcd01 tempest-VolumesSnapshotTestJSON-1451537270 None] Create snapshot completed successfully Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-9c6d45f3-3310-41ff-a7dd-0863c3dd555a-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-9c6d45f3-3310-41ff-a7dd-0863c3dd555a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-9c6d45f3-3310-41ff-a7dd-0863c3dd555a" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-9c6d45f3-3310-41ff-a7dd-0863c3dd555a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Deleting offline snapshot 9c6d45f3-3310-41ff-a7dd-0863c3dd555a of volume 3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] snapshot_file for this snap is: volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7121eb8-dc30-4403-ad86-7c2d0e35ea3e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:10 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a Jun 23 14:05:10 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:10 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 1073741824" returned: 0 in 1.207s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:10 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 Jun 23 14:05:10 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:11 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a" returned: 0 in 0.958s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e45757-d145-421a-b3ab-02dfe3002aea]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:11 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba Jun 23 14:05:11 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:11 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1" returned: 0 in 1.016s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.914s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-82b84ed5-dd9f-43df-bc0f-916b1ae6869a-72107e2c-37e3-4213-a6da-2585358bf69f" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb36938-2f2a-4f61-8d5a-c96936d4a93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f58665-bf56-4908-8dcc-2f30e4301ab1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba79322-116b-4f05-b8e8-528aa437164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-82b84ed5-dd9f-43df-bc0f-916b1ae6869a-72107e2c-37e3-4213-a6da-2585358bf69f" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Creating volume 72107e2c-37e3-4213-a6da-2585358bf69f from snapshot 82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-72107e2c-37e3-4213-a6da-2585358bf69f" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Volume volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 (90f58665-bf56-4908-8dcc-2f30e4301ab1): created successfully Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba79322-116b-4f05-b8e8-528aa437164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (e6351f2f-c85a-4998-a451-e1134258764d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-72107e2c-37e3-4213-a6da-2585358bf69f" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] snapshot: 82b84ed5-dd9f-43df-bc0f-916b1ae6869a, volume: 72107e2c-37e3-4213-a6da-2585358bf69f, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:05:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-df45d0db-3953-438a-9f28-4d5f6d09ad42 tempest-VolumesActionsTest-944139993 None] Created volume successfully. Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e645502-702b-4968-b686-09a3b08fc482]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:11 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a Jun 23 14:05:11 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-73ca087f-33b4-42fd-a439-6b1fe3ce9200 tempest-VolumesActionsTest-944139993 None] Acquiring lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1" by "attach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-73ca087f-33b4-42fd-a439-6b1fe3ce9200 tempest-VolumesActionsTest-944139993 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1" acquired by "attach_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-73ca087f-33b4-42fd-a439-6b1fe3ce9200 tempest-VolumesActionsTest-944139993 None] Attaching volume 90f58665-bf56-4908-8dcc-2f30e4301ab1 to instance dd97704b-287f-4ee9-8572-fe8508c72aea at mountpoint /dev/vdb on host None. Jun 23 14:05:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-73ca087f-33b4-42fd-a439-6b1fe3ce9200 tempest-VolumesActionsTest-944139993 None] Attach volume completed successfully. Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-73ca087f-33b4-42fd-a439-6b1fe3ce9200 tempest-VolumesActionsTest-944139993 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1" released by "attach_volume" :: held 0.285s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:12 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" returned: 0 in 1.422s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:12 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a Jun 23 14:05:12 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:12 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a" returned: 0 in 1.110s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b88e42-5bbd-4d53-b0d0-b9542d3359db]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:12 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:05:12 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:13 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4fb5fe92-0f12-43af-90b5-f69610801514 tempest-VolumesActionsTest-169356233 None] Terminate volume connection completed successfully. Jun 23 14:05:13 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a" returned: 0 in 1.081s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:13 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a Jun 23 14:05:13 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4fb5fe92-0f12-43af-90b5-f69610801514 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-detach_volume" by "detach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4fb5fe92-0f12-43af-90b5-f69610801514 tempest-VolumesActionsTest-169356233 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:13 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 1.178s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:13 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4fb5fe92-0f12-43af-90b5-f69610801514 tempest-VolumesActionsTest-169356233 None] Detaching volume 90f58665-bf56-4908-8dcc-2f30e4301ab1 from instance dd97704b-287f-4ee9-8572-fe8508c72aea. Jun 23 14:05:13 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f Jun 23 14:05:13 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:13 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4fb5fe92-0f12-43af-90b5-f69610801514 tempest-VolumesActionsTest-169356233 None] Detach volume completed successfully. Jun 23 14:05:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4fb5fe92-0f12-43af-90b5-f69610801514 tempest-VolumesActionsTest-169356233 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:14 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-813dbe0d-8720-4d3a-9a18-b9d523f3caf1 tempest-VolumesActionsTest-944139993 None] Acquiring lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-detach_volume" by "detach_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba.9c6d45f3-3310-41ff-a7dd-0863c3dd555a" returned: 0 in 0.973s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-813dbe0d-8720-4d3a-9a18-b9d523f3caf1 tempest-VolumesActionsTest-944139993 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-813dbe0d-8720-4d3a-9a18-b9d523f3caf1 tempest-VolumesActionsTest-944139993 None] Volume detach called, but volume not attached. Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-9c6d45f3-3310-41ff-a7dd-0863c3dd555a" released by "_delete_snapshot" :: held 4.605s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" released by "delete_snapshot" :: held 4.643s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-813dbe0d-8720-4d3a-9a18-b9d523f3caf1 tempest-VolumesActionsTest-944139993 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['64dd2e0a-bef4-41ed-95c7-34b3896a9f75', 'c00ef200-94f2-41ea-b632-6b7a04d402f0', '1f9cb62f-bee7-4a70-bc92-fda855f454df', 'c8effb1f-6c00-472e-85ca-7a60b164fc8d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Delete snapshot completed successfully. Jun 23 14:05:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-61174611-f4a3-48d8-8581-ae0e48b4fcb8 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-9c6d45f3-3310-41ff-a7dd-0863c3dd555a-delete_snapshot" released by "delete_snapshot" :: held 5.016s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Acquiring lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Acquiring lock "cinder-quobyte-90f58665-bf56-4908-8dcc-2f30e4301ab1" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Lock "cinder-quobyte-90f58665-bf56-4908-8dcc-2f30e4301ab1" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:15 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e07af87-ddea-4384-981e-d00f0d63df80]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:16 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 Jun 23 14:05:16 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (adb9299b-8167-4211-9432-ba67f2801489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c6677b-ca33-497e-8dbf-441de0814270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c6677b-ca33-497e-8dbf-441de0814270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1722492423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887fd8e4-def1-448c-8c17-cbf67fea7a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:17Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febe0137-5be3-4057-9551-484277bdf369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febe0137-5be3-4057-9551-484277bdf369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19f7478-12ab-4c1f-a419-a379b2fd2d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19f7478-12ab-4c1f-a419-a379b2fd2d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887fd8e4-def1-448c-8c17-cbf67fea7a59', 'volume_name': 'volume-887fd8e4-def1-448c-8c17-cbf67fea7a59', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9fdee4-95cf-4e56-9bd8-b35e2c92ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9fdee4-95cf-4e56-9bd8-b35e2c92ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2853d50-b141-412c-ae7a-b291d759a4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume 887fd8e4-def1-448c-8c17-cbf67fea7a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887fd8e4-def1-448c-8c17-cbf67fea7a59', 'volume_size': 1} Jun 23 14:05:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1" returned: 0 in 3.055s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:19 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:19 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1 Jun 23 14:05:19 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:20 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-90f58665-bf56-4908-8dcc-2f30e4301ab1" returned: 0 in 1.518s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Lock "cinder-quobyte-90f58665-bf56-4908-8dcc-2f30e4301ab1" released by "delete_volume" :: held 4.695s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:20 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Created reservations ['19d5cdab-7157-4d08-8bab-2501e0f46581', '10b4d819-84b2-466f-a315-51f14ae95ed1', 'e694e98b-2d64-46c4-b491-d2860b311550', 'ca2239dc-e916-4df5-a604-3d8e6464ffc4'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:21 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:21 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:21 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f" returned: 0 in 7.795s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba45ad-5a65-4959-b939-c9d3c73cc3fe]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:21 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:05:21 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:22 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.300s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:22 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:22 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Deleted volume successfully. Jun 23 14:05:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-daa55566-247d-4e94-ab13-5ead5801f407 tempest-VolumesActionsTest-944139993 None] Lock "cinder-90f58665-bf56-4908-8dcc-2f30e4301ab1-delete_volume" released by "delete_volume" :: held 6.595s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:23 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 1.484s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:23 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:05:23 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Converted 1024.00 MB image at 131.34 MB/s Jun 23 14:05:23 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:05:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:23 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f Jun 23 14:05:23 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:24 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f" returned: 0 in 0.956s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-72107e2c-37e3-4213-a6da-2585358bf69f" released by "_copy_volume_from_snapshot" :: held 12.687s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-82b84ed5-dd9f-43df-bc0f-916b1ae6869a-72107e2c-37e3-4213-a6da-2585358bf69f" released by "_create_volume_from_snapshot" :: held 12.756s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.808s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.509s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1722492423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887fd8e4-def1-448c-8c17-cbf67fea7a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:17Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating volume 887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:24 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:24 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 1073741824 Jun 23 14:05:24 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e7ad8a48-b665-4df2-aeff-24ee80bc802a tempest-GroupSnapshotsTest-1328288680 None] Create group from source-snapshot-b6dad147-71eb-4ce4-81c7-62de306acdbf completed successfully. Jun 23 14:05:25 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 1073741824" returned: 0 in 1.213s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:25 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:25 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-72107e2c-37e3-4213-a6da-2585358bf69f" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-72107e2c-37e3-4213-a6da-2585358bf69f" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371da49-d49d-4384-8036-c52e705c5478]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:26 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 0.885s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:26 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:26 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2853d50-b141-412c-ae7a-b291d759a4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887fd8e4-def1-448c-8c17-cbf67fea7a59', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc702307-af78-4d63-ab69-f507085a259c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:26 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 (887fd8e4-def1-448c-8c17-cbf67fea7a59): created successfully Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc702307-af78-4d63-ab69-f507085a259c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (adb9299b-8167-4211-9432-ba67f2801489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-985eb238-f277-4677-9d4a-b78106ca8524 tempest-VolumesSnapshotTestJSON-1451537270 None] Created volume successfully. Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating offline snapshot ced7b1e0-e431-4004-b584-c14d6315de4f of volume 887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7dab19-3f0d-4d49-b69d-10ae1b4bcea5]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:27 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:27 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:27 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f" returned: 0 in 1.186s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:27 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f Jun 23 14:05:27 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:27 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 1.047s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:28 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f 1G Jun 23 14:05:28 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:28 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-72107e2c-37e3-4213-a6da-2585358bf69f" returned: 0 in 0.860s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-72107e2c-37e3-4213-a6da-2585358bf69f" released by "delete_volume" :: held 2.128s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['245fdfbd-7b24-425a-bf68-0cc57ada171b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:28 devstack cinder-volume[93605]: WARNING cinder.quota [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1884673655 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1884673655, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:28 devstack cinder-volume[93605]: WARNING cinder.quota [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1884673655 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1884673655, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['fb0959cf-a005-4fed-8ca4-2841892b660e', '5addcaeb-1966-4aa3-b0e2-7d0ecd25056e', '94f645de-58af-428f-a5db-20cc38d3b5a8', 'd049e117-0fe0-4b6a-b02d-7e66021add7c'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:28 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:28 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:28 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot b6dad147-71eb-4ce4-81c7-62de306acdbf: deleting Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot b6dad147-71eb-4ce4-81c7-62de306acdbf: deleting {{(pid=93605) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-82b84ed5-dd9f-43df-bc0f-916b1ae6869a" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-82b84ed5-dd9f-43df-bc0f-916b1ae6869a" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Deleting offline snapshot 82b84ed5-dd9f-43df-bc0f-916b1ae6869a of volume 6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:05:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] snapshot_file for this snap is: volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09b49a1-d751-4c04-9817-6c94d27da95b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:29 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a Jun 23 14:05:29 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:29 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f 1G" returned: 0 in 1.350s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:29 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f Jun 23 14:05:29 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:29 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.217s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fdc9c502-88e8-4c8a-9019-d89cf2c71363 tempest-GroupSnapshotsTest-1328288680 None] Delete group completed successfully. Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (3eec76b0-906f-43e8-a971-9f5ec08ef83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7528efff-7a41-47dd-87b2-64b8be6f1cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7528efff-7a41-47dd-87b2-64b8be6f1cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1525699335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6e891-9323-4422-85b0-c0273adb4a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:30Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ea592f-ebb0-4e62-a8b5-80e841addbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ea592f-ebb0-4e62-a8b5-80e841addbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cae376-3381-44f3-8c0d-99b1ad2d6fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63cae376-3381-44f3-8c0d-99b1ad2d6fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e6e891-9323-4422-85b0-c0273adb4a5c', 'volume_name': 'volume-a2e6e891-9323-4422-85b0-c0273adb4a5c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f19ddef-fdad-491e-a8db-ccfea16045a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f19ddef-fdad-491e-a8db-ccfea16045a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858479c2-47c3-4dae-b420-5406730482e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:30 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Volume a2e6e891-9323-4422-85b0-c0273adb4a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e6e891-9323-4422-85b0-c0273adb4a5c', 'volume_size': 1} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:30 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a" returned: 0 in 1.315s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea3163f-ae2c-4ccd-becb-d75efd069d5d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:30 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f" returned: 0 in 1.240s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:30 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f is being set with open permissions: ugo+rw Jun 23 14:05:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:30 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:05:30 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:30 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f Jun 23 14:05:30 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:31 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f" returned: 0 in 0.858s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:31 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=62,cinder:UPDATE=52,cinder:DELETE=4,cinder:INSERT=14 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:05:31 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 1.099s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:31 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a Jun 23 14:05:31 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:31 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info Jun 23 14:05:31 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:32 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info" returned: 0 in 0.883s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:32 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info is being set with open permissions: ugo+rw Jun 23 14:05:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:32 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info Jun 23 14:05:32 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:32 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a" returned: 0 in 1.053s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:32 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a Jun 23 14:05:32 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:33 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.info" returned: 0 in 0.920s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.452s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.255s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1525699335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e6e891-9323-4422-85b0-c0273adb4a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:30Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Creating volume a2e6e891-9323-4422-85b0-c0273adb4a5c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:33 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:33 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c 1073741824 Jun 23 14:05:33 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-02408826-eaaf-4db6-8a70-7ec493bce292 tempest-VolumesSnapshotTestJSON-1451537270 None] Create snapshot completed successfully Jun 23 14:05:33 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37.82b84ed5-dd9f-43df-bc0f-916b1ae6869a" returned: 0 in 0.962s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-82b84ed5-dd9f-43df-bc0f-916b1ae6869a" released by "_delete_snapshot" :: held 4.639s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" released by "delete_snapshot" :: held 4.692s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:33 devstack cinder-volume[93605]: WARNING cinder.quota [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1884673655 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1884673655, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:05:33 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['da1dd02d-b85d-4a0b-865a-b4a3fbde0fdc', '5934c396-9004-47ea-8463-95bdfd75dcb5', '082c4ba8-bd4b-46e0-83ec-c39dffbf7467', 'b3a1024f-0a52-4f3c-b40e-2d745d472b8d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c03af798-a1c1-421c-9c03-c83d4ab38675 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot b6dad147-71eb-4ce4-81c7-62de306acdbf: deleted successfully Jun 23 14:05:34 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c 1073741824" returned: 0 in 1.311s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:34 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c Jun 23 14:05:34 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7329b1-cd50-41b9-84d8-78499421ba9c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:35 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:05:35 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (9b770bd7-d718-47f9-ae7e-60a2b828820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfab24e-5b91-47a7-abbc-98c01e7b60d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfab24e-5b91-47a7-abbc-98c01e7b60d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-962440857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b041298e-a2dc-48e8-84a9-3f2215480896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ced7b1e0-e431-4004-b584-c14d6315de4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:35Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c746970-334a-4555-a9c7-3017c5597db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c746970-334a-4555-a9c7-3017c5597db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6d0065-78b9-4261-b3cc-0133b96b9794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6d0065-78b9-4261-b3cc-0133b96b9794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b041298e-a2dc-48e8-84a9-3f2215480896', 'volume_name': 'volume-b041298e-a2dc-48e8-84a9-3f2215480896', 'volume_size': 2, 'snapshot_id': 'ced7b1e0-e431-4004-b584-c14d6315de4f'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d75b97-ea3b-4ee6-8638-aefab5e0d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d75b97-ea3b-4ee6-8638-aefab5e0d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db8b2f5-83c0-4277-b409-f12d982c59e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume b041298e-a2dc-48e8-84a9-3f2215480896: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b041298e-a2dc-48e8-84a9-3f2215480896', 'volume_size': 2, 'snapshot_id': 'ced7b1e0-e431-4004-b584-c14d6315de4f'} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:35 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c" returned: 0 in 1.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] <== create_volume: return (2438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.205s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-ced7b1e0-e431-4004-b584-c14d6315de4f-b041298e-a2dc-48e8-84a9-3f2215480896" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858479c2-47c3-4dae-b420-5406730482e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e6e891-9323-4422-85b0-c0273adb4a5c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86523a6-5f1c-4ae7-97e4-63e0897e8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-ced7b1e0-e431-4004-b584-c14d6315de4f-b041298e-a2dc-48e8-84a9-3f2215480896" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating volume b041298e-a2dc-48e8-84a9-3f2215480896 from snapshot ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-b041298e-a2dc-48e8-84a9-3f2215480896" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Volume volume-a2e6e891-9323-4422-85b0-c0273adb4a5c (a2e6e891-9323-4422-85b0-c0273adb4a5c): created successfully Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86523a6-5f1c-4ae7-97e4-63e0897e8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (3eec76b0-906f-43e8-a971-9f5ec08ef83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-b041298e-a2dc-48e8-84a9-3f2215480896" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] snapshot: ced7b1e0-e431-4004-b584-c14d6315de4f, volume: b041298e-a2dc-48e8-84a9-3f2215480896, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:05:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-734b4b8b-d5ac-45a8-9099-52ca89cdd85f tempest-VolumesActionsTest-944139993 None] Created volume successfully. Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eee07fc-c0ef-4da5-9be4-a9b25641906e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:36 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f Jun 23 14:05:36 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:36 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 1.143s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:36 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37 Jun 23 14:05:36 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-a2e6e891-9323-4422-85b0-c0273adb4a5c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Lock "cinder-a2e6e891-9323-4422-85b0-c0273adb4a5c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-quobyte-a2e6e891-9323-4422-85b0-c0273adb4a5c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-a2e6e891-9323-4422-85b0-c0273adb4a5c" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[439052e4-3540-4905-b387-b7a0449d76da]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:37 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c Jun 23 14:05:37 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:37 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f" returned: 0 in 1.304s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887fd8e4-def1-448c-8c17-cbf67fea7a59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d45f4-ebf6-4721-b515-e8fb97d01977]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:37 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" returned: 0 in 1.122s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-6d3dcf28-005e-4b3b-9938-d04cba6c8d37" released by "delete_volume" :: held 2.428s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:37 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:37 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['59b6fd67-f6f4-4f58-9e11-f666f2bcabb4'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:37 devstack cinder-volume[93605]: WARNING cinder.db.api [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1884673655'] Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['ceff1fdd-8f44-4b0b-a8f3-383626cb757f', '07421cf7-a793-4693-8c5c-d40e132c2241', 'cf239182-37b4-453d-a361-26b42bb6c903', 'e9bdc2cf-f443-498c-89d2-6a00f9fca98d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:38 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:38 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:38 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c" returned: 0 in 1.292s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:38 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c Jun 23 14:05:38 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:38 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 1.248s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:38 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 Jun 23 14:05:38 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:38 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.916s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:38 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4db82805-c4bc-4905-9bb7-dbdeadb4a824 tempest-GroupSnapshotsTest-1328288680 None] Delete group completed successfully. Jun 23 14:05:39 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a2e6e891-9323-4422-85b0-c0273adb4a5c" returned: 0 in 0.917s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-a2e6e891-9323-4422-85b0-c0273adb4a5c" released by "delete_volume" :: held 2.272s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Created reservations ['a92f90af-9061-41f1-9045-74ff76170fbd', '52502332-7cfb-4128-96b2-1f125870027b', 'ce2f42fb-0a81-43c8-aa9d-6381498a5ae1', '86478e0b-a4ce-4a7e-939d-5f948942052b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:39 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:39 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c02a9a11-2724-4905-a4fe-50536e86eec2 tempest-GroupSnapshotsTest-1328288680 None] Group tempest-GroupSnapshotsTest-Group-437453692: creating Jun 23 14:05:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c02a9a11-2724-4905-a4fe-50536e86eec2 tempest-GroupSnapshotsTest-1328288680 None] Group tempest-GroupSnapshotsTest-Group-437453692: created successfully Jun 23 14:05:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c02a9a11-2724-4905-a4fe-50536e86eec2 tempest-GroupSnapshotsTest-1328288680 None] Create group completed successfully. Jun 23 14:05:42 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 2.596s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:42 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Deleted volume successfully. Jun 23 14:05:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4a3718ac-55d7-4148-bb6f-a5b8ab1b6ad4 tempest-VolumesActionsTest-169356233 None] Lock "cinder-a2e6e891-9323-4422-85b0-c0273adb4a5c-delete_volume" released by "delete_volume" :: held 5.320s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (82345178-520c-4a51-b365-2ca7a476f026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfaed3e-b5c1-487a-a35c-8d1dbf41aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (126887c8-dbc8-4659-a329-98ac77e1ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bd96db-614f-44c9-99d4-3d495b266f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfaed3e-b5c1-487a-a35c-8d1dbf41aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1100267745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cd656f-4651-4dac-a4d7-4abb677d1d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:43Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1aa976-45d0-456b-8229-4b25f0fde1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1aa976-45d0-456b-8229-4b25f0fde1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89927dfc-7d3d-4a63-907b-93c78023f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89927dfc-7d3d-4a63-907b-93c78023f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cd656f-4651-4dac-a4d7-4abb677d1d85', 'volume_name': 'volume-42cd656f-4651-4dac-a4d7-4abb677d1d85', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961815b9-7f87-4bd7-96cd-d3320ed429a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (961815b9-7f87-4bd7-96cd-d3320ed429a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012a82c6-3685-467f-b21a-d4a787e0f303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Volume 42cd656f-4651-4dac-a4d7-4abb677d1d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cd656f-4651-4dac-a4d7-4abb677d1d85', 'volume_size': 1} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bd96db-614f-44c9-99d4-3d495b266f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902771534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df0a4e71-4689-4d6d-8947-f9457e388a55,host='devstack@QuobyteHD#QuobyteHD',id=a38d4436-f5d0-45c2-8958-d70164cc22d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:43Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(757b3da8-aa8c-46f5-8fcc-a20b975acd33),volume_type_id=757b3da8-aa8c-46f5-8fcc-a20b975acd33)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69932c5a-5080-41f1-8f88-73b10f035b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69932c5a-5080-41f1-8f88-73b10f035b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4602dd34-3268-4aaf-bc1f-9dd027f0c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4602dd34-3268-4aaf-bc1f-9dd027f0c247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38d4436-f5d0-45c2-8958-d70164cc22d0', 'volume_name': 'volume-a38d4436-f5d0-45c2-8958-d70164cc22d0', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e822af3-5d37-4517-87ae-2cd089b20327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e822af3-5d37-4517-87ae-2cd089b20327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa28ac0b-95ef-41f3-8ab8-430fc10d97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Volume a38d4436-f5d0-45c2-8958-d70164cc22d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38d4436-f5d0-45c2-8958-d70164cc22d0', 'volume_size': 1} Jun 23 14:05:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:46 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896" returned: 0 in 7.516s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb19e7-bd32-434d-97b2-3f1a2aa28d02]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:46 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:46 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:47 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 1.176s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:47 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:05:47 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Converted 1024.00 MB image at 136.22 MB/s Jun 23 14:05:47 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 is being set with open permissions: ugo+rw Jun 23 14:05:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:47 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 Jun 23 14:05:47 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:48 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896" returned: 0 in 0.808s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-b041298e-a2dc-48e8-84a9-3f2215480896" released by "_copy_volume_from_snapshot" :: held 12.200s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-ced7b1e0-e431-4004-b584-c14d6315de4f-b041298e-a2dc-48e8-84a9-3f2215480896" released by "_create_volume_from_snapshot" :: held 12.285s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.338s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.332s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1100267745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cd656f-4651-4dac-a4d7-4abb677d1d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:43Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Creating volume 42cd656f-4651-4dac-a4d7-4abb677d1d85 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:48 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:48 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 1073741824 Jun 23 14:05:48 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db8b2f5-83c0-4277-b409-f12d982c59e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b041298e-a2dc-48e8-84a9-3f2215480896', 'volume_size': 2, 'snapshot_id': 'ced7b1e0-e431-4004-b584-c14d6315de4f'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f44838d-401c-4fab-87c8-7e1272f9518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:48 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume volume-b041298e-a2dc-48e8-84a9-3f2215480896 (b041298e-a2dc-48e8-84a9-3f2215480896): created successfully Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f44838d-401c-4fab-87c8-7e1272f9518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (9b770bd7-d718-47f9-ae7e-60a2b828820b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ae27a718-9b19-424f-83ae-48ce26155345 tempest-VolumesSnapshotTestJSON-1451537270 None] Created volume successfully. Jun 23 14:05:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-b041298e-a2dc-48e8-84a9-3f2215480896-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-b041298e-a2dc-48e8-84a9-3f2215480896-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-b041298e-a2dc-48e8-84a9-3f2215480896" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-b041298e-a2dc-48e8-84a9-3f2215480896" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd5a81-5478-435b-b4cd-b4ac7225d32a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:49 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 Jun 23 14:05:49 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:49 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 1073741824" returned: 0 in 1.330s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:49 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 Jun 23 14:05:49 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:50 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896" returned: 0 in 1.290s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:50 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896 Jun 23 14:05:50 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:50 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85" returned: 0 in 1.196s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.795s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df0a4e71-4689-4d6d-8947-f9457e388a55,created_at=2026-06-23T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1902771534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df0a4e71-4689-4d6d-8947-f9457e388a55,host='devstack@QuobyteHD#QuobyteHD',id=a38d4436-f5d0-45c2-8958-d70164cc22d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:43Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(757b3da8-aa8c-46f5-8fcc-a20b975acd33),volume_type_id=757b3da8-aa8c-46f5-8fcc-a20b975acd33)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Creating volume a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:50 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012a82c6-3685-467f-b21a-d4a787e0f303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cd656f-4651-4dac-a4d7-4abb677d1d85', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:50 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 1073741824 Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7785a61-722e-46a6-bc09-7377724ccf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:50 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:50 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Volume volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 (42cd656f-4651-4dac-a4d7-4abb677d1d85): created successfully Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7785a61-722e-46a6-bc09-7377724ccf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (82345178-520c-4a51-b365-2ca7a476f026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c3e134a3-c82c-4a1d-8323-3a24c1f728cf tempest-VolumesActionsTest-944139993 None] Created volume successfully. Jun 23 14:05:51 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b041298e-a2dc-48e8-84a9-3f2215480896" returned: 0 in 0.892s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-b041298e-a2dc-48e8-84a9-3f2215480896" released by "delete_volume" :: held 2.261s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['b3862aac-d6a3-44bc-a1d3-e48fc555f677', 'e3f568dc-bc53-4009-9115-8a3944d54256', '970204fb-815d-4641-9ccb-7328fd25084c', '9e4bde95-a063-41e1-a590-b095aaed0c47'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:51 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:51 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:51 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:51 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-42cd656f-4651-4dac-a4d7-4abb677d1d85-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Lock "cinder-42cd656f-4651-4dac-a4d7-4abb677d1d85-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-quobyte-42cd656f-4651-4dac-a4d7-4abb677d1d85" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-42cd656f-4651-4dac-a4d7-4abb677d1d85" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1f005-7b35-47be-85dd-f47525767506]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:52 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 1073741824" returned: 0 in 1.301s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:52 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 Jun 23 14:05:52 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:52 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 Jun 23 14:05:52 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-ced7b1e0-e431-4004-b584-c14d6315de4f-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-ced7b1e0-e431-4004-b584-c14d6315de4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-887fd8e4-def1-448c-8c17-cbf67fea7a59" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-887fd8e4-def1-448c-8c17-cbf67fea7a59" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-ced7b1e0-e431-4004-b584-c14d6315de4f" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-ced7b1e0-e431-4004-b584-c14d6315de4f" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Deleting offline snapshot ced7b1e0-e431-4004-b584-c14d6315de4f of volume 887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] snapshot_file for this snap is: volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d247f-67cd-4e8a-9cde-39359abb5120]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:52 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.331s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Deleted volume successfully. Jun 23 14:05:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e82fe7a5-31fd-4c10-911c-040f75f26a24 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-b041298e-a2dc-48e8-84a9-3f2215480896-delete_volume" released by "delete_volume" :: held 3.983s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:53 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.432s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:05:53 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f Jun 23 14:05:53 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:53 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0" returned: 0 in 1.164s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] <== create_volume: return (2559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:53 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85" returned: 0 in 1.301s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa28ac0b-95ef-41f3-8ab8-430fc10d97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38d4436-f5d0-45c2-8958-d70164cc22d0', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf63a56-4be6-424a-a243-34f19a5f737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:53 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85 Jun 23 14:05:53 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Volume volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 (a38d4436-f5d0-45c2-8958-d70164cc22d0): created successfully Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf63a56-4be6-424a-a243-34f19a5f737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (126887c8-dbc8-4659-a329-98ac77e1ac27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-95abc341-3b4c-49df-9d5e-9f9df1fb1049 tempest-GroupSnapshotsTest-1328288680 None] Created volume successfully. Jun 23 14:05:53 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f" returned: 0 in 1.103s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887fd8e4-def1-448c-8c17-cbf67fea7a59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe90bdc-e681-4fda-b2bf-575add3150d1]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:54 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-42cd656f-4651-4dac-a4d7-4abb677d1d85" returned: 0 in 0.817s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:54 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:54 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-42cd656f-4651-4dac-a4d7-4abb677d1d85" released by "delete_volume" :: held 2.198s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Created reservations ['faf7f6e8-e2b8-4ac8-b528-3c4a2497466a', 'a49c38a9-24c2-422d-933e-858b08bcbbb6', '97e6a087-9430-46f2-a589-f6d0e5893f21', 'a62698fe-70f0-4b4a-b52b-dbd27355f625'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:54 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:05:54 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:55 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 1.081s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:55 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f Jun 23 14:05:55 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (e204d10b-4dd7-4ad1-a96d-814fcba401ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbfaea3-c3ad-47db-a646-53da396363c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbfaea3-c3ad-47db-a646-53da396363c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789469588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df0a4e71-4689-4d6d-8947-f9457e388a55,host='devstack@QuobyteHD#QuobyteHD',id=2bd4ae10-1a97-4e23-aea8-33e899358761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:55Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(757b3da8-aa8c-46f5-8fcc-a20b975acd33),volume_type_id=757b3da8-aa8c-46f5-8fcc-a20b975acd33)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:55 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2ab95d-8b83-4c24-8444-342ab6456e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2ab95d-8b83-4c24-8444-342ab6456e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2eb1830-a1ef-4d1a-a2b5-d5a93677b810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2eb1830-a1ef-4d1a-a2b5-d5a93677b810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd4ae10-1a97-4e23-aea8-33e899358761', 'volume_name': 'volume-2bd4ae10-1a97-4e23-aea8-33e899358761', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02749c80-cfa0-4862-878a-8e51db885697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02749c80-cfa0-4862-878a-8e51db885697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524751f6-4937-445c-9532-b89749f87fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:55 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Volume 2bd4ae10-1a97-4e23-aea8-33e899358761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd4ae10-1a97-4e23-aea8-33e899358761', 'volume_size': 1} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df0a4e71-4689-4d6d-8947-f9457e388a55,created_at=2026-06-23T12:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-789469588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df0a4e71-4689-4d6d-8947-f9457e388a55,host='devstack@QuobyteHD#QuobyteHD',id=2bd4ae10-1a97-4e23-aea8-33e899358761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:55Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(757b3da8-aa8c-46f5-8fcc-a20b975acd33),volume_type_id=757b3da8-aa8c-46f5-8fcc-a20b975acd33)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Creating volume 2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:55 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.257s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:05:55 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 1073741824 Jun 23 14:05:55 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Deleted volume successfully. Jun 23 14:05:55 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-3455ccf4-988d-4c90-a127-67bf9890be31 tempest-VolumesActionsTest-169356233 None] Lock "cinder-42cd656f-4651-4dac-a4d7-4abb677d1d85-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=103,cinder:SELECT=101,cinder:INSERT=21,cinder:DELETE=6 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (5f0024d5-54a3-44b7-b1f1-4bedf61324b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:56 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91e8a08-437b-4fac-9638-e604f876dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f" returned: 0 in 1.452s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91e8a08-437b-4fac-9638-e604f876dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396820365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a3d662-1ab9-4968-9906-2a9b46a1cf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:56Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:56 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f Jun 23 14:05:56 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9311fe-5e1f-40d6-9d23-b04623d95bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9311fe-5e1f-40d6-9d23-b04623d95bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb3bc16-fa30-406d-92c5-586bc7f3114a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cb3bc16-fa30-406d-92c5-586bc7f3114a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a3d662-1ab9-4968-9906-2a9b46a1cf28', 'volume_name': 'volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcea90e-90b7-40e2-97a8-c59b30a805b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dcea90e-90b7-40e2-97a8-c59b30a805b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c8e428-3fbf-49d1-be4a-54ec52e0dbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Volume e8a3d662-1ab9-4968-9906-2a9b46a1cf28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28', 'volume_size': 1} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:56 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Flow 'volume_create_manager' (7a80259e-5528-487b-ba32-3305ce0bb980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb93367-93ca-49ba-8d8c-ff1454614043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb93367-93ca-49ba-8d8c-ff1454614043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-204018399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08149ff-a574-45cc-9ce9-78ec746e8569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2d79d314234b0c9527c8e1e4cd1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:57Z,use_quota=True,user_id='98e005181aaf403a9965c6652d2439da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66029a6e-f965-4e34-8228-e29cdf458a5f),volume_type_id=66029a6e-f965-4e34-8228-e29cdf458a5f)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e42f16f-5817-4a0a-bd39-3e9d226db442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e42f16f-5817-4a0a-bd39-3e9d226db442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5783dab0-eb4b-4368-b0c9-127667fbbb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5783dab0-eb4b-4368-b0c9-127667fbbb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c08149ff-a574-45cc-9ce9-78ec746e8569', 'volume_name': 'volume-c08149ff-a574-45cc-9ce9-78ec746e8569', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43312ef-7e9f-4f8e-8313-4da0ff1407ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43312ef-7e9f-4f8e-8313-4da0ff1407ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc51df7-9a45-447f-9a0d-18a13696b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume c08149ff-a574-45cc-9ce9-78ec746e8569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c08149ff-a574-45cc-9ce9-78ec746e8569', 'volume_size': 1} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 1073741824" returned: 0 in 1.602s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:57 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 Jun 23 14:05:57 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:57 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Flow 'volume_create_manager' (31135ed6-a479-4aca-923d-2c87f3ee5e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc34fe6-3678-46ca-97ad-fab1913339ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59.ced7b1e0-e431-4004-b584-c14d6315de4f" returned: 0 in 1.035s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc34fe6-3678-46ca-97ad-fab1913339ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1460652230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361340ea-8d6a-49ba-9078-7b2477f64d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2d79d314234b0c9527c8e1e4cd1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:57Z,use_quota=True,user_id='98e005181aaf403a9965c6652d2439da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff21543e-6c6d-4592-b5d7-6ef15875a99b),volume_type_id=ff21543e-6c6d-4592-b5d7-6ef15875a99b)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a990afea-b5b0-45c9-b794-a20db23fd514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a990afea-b5b0-45c9-b794-a20db23fd514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34f1574-8773-477b-a297-69844f57b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34f1574-8773-477b-a297-69844f57b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361340ea-8d6a-49ba-9078-7b2477f64d04', 'volume_name': 'volume-361340ea-8d6a-49ba-9078-7b2477f64d04', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05277582-43ac-4b56-9594-4e478c2d5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05277582-43ac-4b56-9594-4e478c2d5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fed2de5-320c-4043-861f-b5bb41fcf637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:57 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume 361340ea-8d6a-49ba-9078-7b2477f64d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361340ea-8d6a-49ba-9078-7b2477f64d04', 'volume_size': 1} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-ced7b1e0-e431-4004-b584-c14d6315de4f" released by "_delete_snapshot" :: held 4.887s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-887fd8e4-def1-448c-8c17-cbf67fea7a59" released by "delete_snapshot" :: held 4.935s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['e82cf17e-076a-467e-b65a-692bc9b26ddc', '50b4d317-0fe5-4cd6-8b86-d7c7b65a20b5', '9e8e1913-b2a1-4587-b39c-373c3ca066f8', 'a851cd26-a2db-4b2c-8952-181af9dedfae'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:05:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Delete snapshot completed successfully. Jun 23 14:05:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-90236e3b-c3ef-4fa3-9c66-258f3498efc0 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-ced7b1e0-e431-4004-b584-c14d6315de4f-delete_snapshot" released by "delete_snapshot" :: held 5.131s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:05:58 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761" returned: 0 in 0.871s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.556s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396820365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a3d662-1ab9-4968-9906-2a9b46a1cf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:56Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Creating volume e8a3d662-1ab9-4968-9906-2a9b46a1cf28 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:05:58 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524751f6-4937-445c-9532-b89749f87fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd4ae10-1a97-4e23-aea8-33e899358761', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe94a04-8d58-4745-a24a-66ab8ad3fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 1073741824 Jun 23 14:05:58 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:58 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Volume volume-2bd4ae10-1a97-4e23-aea8-33e899358761 (2bd4ae10-1a97-4e23-aea8-33e899358761): created successfully Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe94a04-8d58-4745-a24a-66ab8ad3fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (e204d10b-4dd7-4ad1-a96d-814fcba401ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e4787d4b-f720-4533-bdff-5d8d94c64d63 tempest-GroupSnapshotsTest-1328288680 None] Created volume successfully. Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Flow 'volume_create_manager' (74951aba-133e-4ba8-b8e4-849d235e24a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3a34ad-eab9-49b2-aa6e-7dbeb6cbb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3a34ad-eab9-49b2-aa6e-7dbeb6cbb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-168129562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d4e178-00b1-458a-a5b9-b3aaae7d8124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2d79d314234b0c9527c8e1e4cd1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:58Z,use_quota=True,user_id='98e005181aaf403a9965c6652d2439da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b923b498-53ce-4962-98c6-63728c3b18ff),volume_type_id=b923b498-53ce-4962-98c6-63728c3b18ff)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7217db5f-8df6-4c67-be53-5dcf2ca0914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7217db5f-8df6-4c67-be53-5dcf2ca0914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf34e37d-337a-435d-b043-6701c313b45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-887fd8e4-def1-448c-8c17-cbf67fea7a59-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-887fd8e4-def1-448c-8c17-cbf67fea7a59-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-887fd8e4-def1-448c-8c17-cbf67fea7a59" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-887fd8e4-def1-448c-8c17-cbf67fea7a59" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab47ea-05ba-4256-b831-806411eee738]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:58 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:58 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf34e37d-337a-435d-b043-6701c313b45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45d4e178-00b1-458a-a5b9-b3aaae7d8124', 'volume_name': 'volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124', 'volume_size': 1, 'image_id': '179081e6-d234-49ab-bbc4-daebf318749a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/179081e6-d234-49ab-bbc4-daebf318749a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--163357673', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f2d79d314234b0c9527c8e1e4cd1930', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '179081e6-d234-49ab-bbc4-daebf318749a', 'created_at': datetime.datetime(2026, 6, 23, 12, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 5, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/179081e6-d234-49ab-bbc4-daebf318749a/file', 'properties': {}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d3d0b6-3cb6-47fd-bc8a-e4a046f60ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d3d0b6-3cb6-47fd-bc8a-e4a046f60ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bd0ed7-2f80-4667-9648-98021a5dab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:05:58 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume 45d4e178-00b1-458a-a5b9-b3aaae7d8124: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124', 'volume_size': 1, 'image_id': '179081e6-d234-49ab-bbc4-daebf318749a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/179081e6-d234-49ab-bbc4-daebf318749a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--163357673', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f2d79d314234b0c9527c8e1e4cd1930', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '179081e6-d234-49ab-bbc4-daebf318749a', 'created_at': datetime.datetime(2026, 6, 23, 12, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 5, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/179081e6-d234-49ab-bbc4-daebf318749a/file', 'properties': {}}, 'image_service': } Jun 23 14:05:58 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Trying to clone 45d4e178-00b1-458a-a5b9-b3aaae7d8124 from image 179081e6-d234-49ab-bbc4-daebf318749a at location (None, [{'url': 'file:///opt/stack/data/glance/images/179081e6-d234-49ab-bbc4-daebf318749a', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:05:59 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 1073741824" returned: 0 in 1.164s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:59 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 Jun 23 14:05:59 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:59 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jun 23 14:05:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 1.086s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:05:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:05:59 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59 Jun 23 14:05:59 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:05:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-94e7824b-f460-4d34-abc3-467f05f6ee37 tempest-GroupSnapshotsTest-1328288680 None] Update group completed successfully. Jun 23 14:06:00 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28" returned: 0 in 0.860s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.064s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-204018399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c08149ff-a574-45cc-9ce9-78ec746e8569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2d79d314234b0c9527c8e1e4cd1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:57Z,use_quota=True,user_id='98e005181aaf403a9965c6652d2439da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66029a6e-f965-4e34-8228-e29cdf458a5f),volume_type_id=66029a6e-f965-4e34-8228-e29cdf458a5f)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Creating volume c08149ff-a574-45cc-9ce9-78ec746e8569 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:00 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c8e428-3fbf-49d1-be4a-54ec52e0dbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:00 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 1073741824 Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89e1690-821e-49ce-be21-4496639e55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:00 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:00 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Volume volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 (e8a3d662-1ab9-4968-9906-2a9b46a1cf28): created successfully Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89e1690-821e-49ce-be21-4496639e55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (5f0024d5-54a3-44b7-b1f1-4bedf61324b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:00 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1c682fd6-cbd5-4a46-b7fb-ca38a05bbfde tempest-VolumesActionsTest-944139993 None] Created volume successfully. Jun 23 14:06:00 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-887fd8e4-def1-448c-8c17-cbf67fea7a59" returned: 0 in 0.769s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-887fd8e4-def1-448c-8c17-cbf67fea7a59" released by "delete_volume" :: held 1.925s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['9b0b4817-1e35-468d-a60a-29c2b897c545', '4d487709-a4b4-4b23-bed8-96270b3d7c98', 'f7946d98-9d59-4e54-9c7f-9ff84a12df06', 'b128f72c-ecff-41e1-8f9a-dc1551e3bf55'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:00 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:00 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-e8a3d662-1ab9-4968-9906-2a9b46a1cf28-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9076d035-5a34-4a49-bde3-9c49e4871a70 tempest-GroupSnapshotsTest-1328288680 None] Update group completed successfully. Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Lock "cinder-e8a3d662-1ab9-4968-9906-2a9b46a1cf28-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-quobyte-e8a3d662-1ab9-4968-9906-2a9b46a1cf28" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-e8a3d662-1ab9-4968-9906-2a9b46a1cf28" acquired by "delete_volume" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a9612-970c-445a-96f7-47469b944409]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:01 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 Jun 23 14:06:01 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b7381d20-7c8f-4119-80db-913798739020 tempest-GroupSnapshotsTest-1328288680 None] Update group completed successfully. Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (25b1137d-f3d4-4f47-ba0a-36303daa9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a3a8f8-ae43-4bf2-be34-84db04ef3da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a3a8f8-ae43-4bf2-be34-84db04ef3da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1562057056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1151692e-62b0-4468-bb54-260fb5eab900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:02Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2384181-e5ab-4b0e-90d6-8b80c738cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2384181-e5ab-4b0e-90d6-8b80c738cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc8c857-88d5-4ed2-8845-7fe1beef9bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc8c857-88d5-4ed2-8845-7fe1beef9bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1151692e-62b0-4468-bb54-260fb5eab900', 'volume_name': 'volume-1151692e-62b0-4468-bb54-260fb5eab900', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33751555-e91d-4703-b1fb-cd18e83713ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33751555-e91d-4703-b1fb-cd18e83713ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24c7546-630a-42cf-8946-10e7be1baaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:01 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume 1151692e-62b0-4468-bb54-260fb5eab900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1151692e-62b0-4468-bb54-260fb5eab900', 'volume_size': 1} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:01 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 1073741824" returned: 0 in 1.514s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:01 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 Jun 23 14:06:01 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b66e8574-cb95-459a-b89f-1f0945d41249 tempest-GroupSnapshotsTest-1328288680 None] Update group completed successfully. Jun 23 14:06:02 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.368s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Deleted volume successfully. Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cf253b63-d333-4a4b-911a-40c93c3fb6fe tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-887fd8e4-def1-448c-8c17-cbf67fea7a59-delete_volume" released by "delete_volume" :: held 3.620s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:02 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28" returned: 0 in 1.095s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:02 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28 Jun 23 14:06:02 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:02 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569" returned: 0 in 0.881s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] <== create_volume: return (2473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.478s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.069s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1460652230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361340ea-8d6a-49ba-9078-7b2477f64d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2d79d314234b0c9527c8e1e4cd1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:57Z,use_quota=True,user_id='98e005181aaf403a9965c6652d2439da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff21543e-6c6d-4592-b5d7-6ef15875a99b),volume_type_id=ff21543e-6c6d-4592-b5d7-6ef15875a99b)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Creating volume 361340ea-8d6a-49ba-9078-7b2477f64d04 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:02 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc51df7-9a45-447f-9a0d-18a13696b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c08149ff-a574-45cc-9ce9-78ec746e8569', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:02 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 1073741824 Jun 23 14:06:02 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182bcda2-c5a6-498d-9ae3-5667d54107d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:02 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume volume-c08149ff-a574-45cc-9ce9-78ec746e8569 (c08149ff-a574-45cc-9ce9-78ec746e8569): created successfully Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182bcda2-c5a6-498d-9ae3-5667d54107d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Flow 'volume_create_manager' (7a80259e-5528-487b-ba32-3305ce0bb980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-25af2061-db1f-425b-8695-9cc6f9f92541 tempest-TestInstancesWithCinderVolumes-1629233990 None] Created volume successfully. Jun 23 14:06:03 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e8a3d662-1ab9-4968-9906-2a9b46a1cf28" returned: 0 in 0.899s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-e8a3d662-1ab9-4968-9906-2a9b46a1cf28" released by "delete_volume" :: held 2.070s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Created reservations ['2ae9c9c0-c0b1-40ce-8cf2-c40a8b70d96a', '94cbbae8-e21e-4c5f-92bb-90316ddd15bc', 'dd0c1baf-b0cb-4d81-a04d-319902fc342a', '45324661-8d23-4b7f-92ca-eabe2751e906'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:03 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:03 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] GroupSnapshot bd41caf3-3ca6-4168-838a-ef326ae88f1f: creating. Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Group snapshot bd41caf3-3ca6-4168-838a-ef326ae88f1f: creating. {{(pid=93605) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:03 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 1073741824" returned: 0 in 1.225s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:04 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 Jun 23 14:06:04 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD, size 20.69 MB, duration 5.38 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:06:04 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Image download 20.69 MB at 3.85 MB/s Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a1e560-d389-41db-b53e-423cccfec19e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:04 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD Jun 23 14:06:04 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:04 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.836s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Deleted volume successfully. Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-17262e96-e1b0-4c47-804b-c200be524b41 tempest-VolumesActionsTest-169356233 None] Lock "cinder-e8a3d662-1ab9-4968-9906-2a9b46a1cf28-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:04 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04" returned: 0 in 0.761s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1562057056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1151692e-62b0-4468-bb54-260fb5eab900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:02Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Creating volume 1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:04 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:04 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 1073741824 Jun 23 14:06:04 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fed2de5-320c-4043-861f-b5bb41fcf637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361340ea-8d6a-49ba-9078-7b2477f64d04', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e4601a-5d0d-4c46-84be-054a9f66a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:04 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume volume-361340ea-8d6a-49ba-9078-7b2477f64d04 (361340ea-8d6a-49ba-9078-7b2477f64d04): created successfully Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e4601a-5d0d-4c46-84be-054a9f66a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Flow 'volume_create_manager' (31135ed6-a479-4aca-923d-2c87f3ee5e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1898d99f-6583-42c4-839b-b4a554a9e91e tempest-TestInstancesWithCinderVolumes-1629233990 None] Created volume successfully. Jun 23 14:06:05 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Temporary image 179081e6-d234-49ab-bbc4-daebf318749a is fetched for user 98e005181aaf403a9965c6652d2439da. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ff84d-de2b-478e-a2e8-b2f92888ee27]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:05 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD Jun 23 14:06:05 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (21b337b0-c1fb-4265-bd59-579317b08060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b62a3-a4b8-4f8b-a291-45e2934555f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b62a3-a4b8-4f8b-a291-45e2934555f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162970019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62e56f5-39d4-4b5b-9b92-2533508bd083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:05Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfa70d4-3abc-44a8-b82d-d623e0c15fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfa70d4-3abc-44a8-b82d-d623e0c15fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dbb73b-9e59-4094-a709-94679eea2583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6dbb73b-9e59-4094-a709-94679eea2583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62e56f5-39d4-4b5b-9b92-2533508bd083', 'volume_name': 'volume-c62e56f5-39d4-4b5b-9b92-2533508bd083', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57df7ea9-82e0-47cd-be3e-7c5d564646da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57df7ea9-82e0-47cd-be3e-7c5d564646da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f2cd1-7e7d-4599-81d9-ecedc0a8aa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:05 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Volume c62e56f5-39d4-4b5b-9b92-2533508bd083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62e56f5-39d4-4b5b-9b92-2533508bd083', 'volume_size': 1} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:05 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 1073741824" returned: 0 in 0.973s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:05 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:05 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:06 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD" returned: 0 in 0.909s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:06 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 0.711s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.857s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Creating offline snapshot 999390c8-6aab-485c-9b20-a8733400a28c of volume a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24c7546-630a-42cf-8946-10e7be1baaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1151692e-62b0-4468-bb54-260fb5eab900', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b4efc5-a11a-4d78-b34f-d7b31c2fe9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2440ef8-77c0-438d-81f3-9f0b34319a3e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:06 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Volume volume-1151692e-62b0-4468-bb54-260fb5eab900 (1151692e-62b0-4468-bb54-260fb5eab900): created successfully Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b4efc5-a11a-4d78-b34f-d7b31c2fe9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (25b1137d-f3d4-4f47-ba0a-36303daa9375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:06 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0c13de8a-5744-4fda-916f-cdd594d874a7 tempest-VolumesSnapshotTestJSON-1451537270 None] Created volume successfully. Jun 23 14:06:06 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 Jun 23 14:06:06 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:07 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0" returned: 0 in 0.896s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:07 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c 1G Jun 23 14:06:07 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:08 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c 1G" returned: 0 in 0.902s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:08 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c Jun 23 14:06:08 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:09 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c" returned: 0 in 0.771s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:09 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:06:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:09 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c Jun 23 14:06:09 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:09 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c" returned: 0 in 0.731s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:09 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info Jun 23 14:06:09 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:10 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info" returned: 0 in 0.760s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:10 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:06:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:10 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info Jun 23 14:06:10 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:11 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.info" returned: 0 in 0.719s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Creating offline snapshot a9d98c7d-66e3-4602-be3b-161325a413f4 of volume 2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[806f45a7-f0a2-4227-9c79-78f305c09e27]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:11 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 Jun 23 14:06:11 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:12 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761" returned: 0 in 0.848s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:12 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 1G Jun 23 14:06:12 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:13 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 1G" returned: 0 in 0.901s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd4ae10-1a97-4e23-aea8-33e899358761 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:13 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd4ae10-1a97-4e23-aea8-33e899358761 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 Jun 23 14:06:13 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:14 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd4ae10-1a97-4e23-aea8-33e899358761 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4" returned: 0 in 0.761s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:14 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:06:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:14 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 Jun 23 14:06:14 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:14 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4" returned: 0 in 0.701s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:14 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info Jun 23 14:06:14 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:15 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info" returned: 0 in 0.705s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:15 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:06:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:15 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info Jun 23 14:06:15 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:16 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.info" returned: 0 in 0.691s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.708s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.071s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-168129562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d4e178-00b1-458a-a5b9-b3aaae7d8124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2d79d314234b0c9527c8e1e4cd1930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:05:58Z,use_quota=True,user_id='98e005181aaf403a9965c6652d2439da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b923b498-53ce-4962-98c6-63728c3b18ff),volume_type_id=b923b498-53ce-4962-98c6-63728c3b18ff)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Creating volume 45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:16 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:16 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 1073741824 Jun 23 14:06:16 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-79987d14-f1b6-4ebb-a882-8828ceef0c38 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot bd41caf3-3ca6-4168-838a-ef326ae88f1f: created successfully Jun 23 14:06:17 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 1073741824" returned: 0 in 0.992s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:17 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:06:17 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot bd41caf3-3ca6-4168-838a-ef326ae88f1f: deleting Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot bd41caf3-3ca6-4168-838a-ef326ae88f1f: deleting {{(pid=93605) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-a38d4436-f5d0-45c2-8958-d70164cc22d0" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-a38d4436-f5d0-45c2-8958-d70164cc22d0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-999390c8-6aab-485c-9b20-a8733400a28c" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-999390c8-6aab-485c-9b20-a8733400a28c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Deleting offline snapshot 999390c8-6aab-485c-9b20-a8733400a28c of volume a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] snapshot_file for this snap is: volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b901e2e-4cce-4661-9c34-17a582798ee0]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:17 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c Jun 23 14:06:17 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:18 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 0 in 0.841s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.691s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Creating offline snapshot 3fe5a14e-984d-4ce2-903b-c254bb6dd075 of volume 1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Attempting download of 179081e6-d234-49ab-bbc4-daebf318749a ((None, [{'url': 'file:///opt/stack/data/glance/images/179081e6-d234-49ab-bbc4-daebf318749a', 'metadata': {}}])) to volume 45d4e178-00b1-458a-a5b9-b3aaae7d8124. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c9f73-ab61-4e27-bb4d-24f16753a10c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[72733c58-9f09-483d-a664-801c47ff23dc]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:18 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:18 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:18 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m Jun 23 14:06:18 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:18 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c" returned: 0 in 0.957s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a38d4436-f5d0-45c2-8958-d70164cc22d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ca6ce-bf81-4c11-b4a2-b4fa227a4e24]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:18 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 Jun 23 14:06:18 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:19 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 0.987s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:19 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 1G Jun 23 14:06:19 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:19 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m" returned: 0 in 0.966s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:19 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m Jun 23 14:06:19 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:19 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0" returned: 0 in 0.916s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:19 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c Jun 23 14:06:19 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:20 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m" returned: 1 in 0.922s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179081e6-d234-49ab-bbc4-daebf318749a_gifwmx1m' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[179fa5da-d78e-4a4b-b4b8-caa43079d0b4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:20 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 1G" returned: 0 in 0.993s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1151692e-62b0-4468-bb54-260fb5eab900 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:20 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1151692e-62b0-4468-bb54-260fb5eab900 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 Jun 23 14:06:20 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:20 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD Jun 23 14:06:20 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:20 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c" returned: 0 in 0.859s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:20 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c Jun 23 14:06:20 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:20 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] 179081e6-d234-49ab-bbc4-daebf318749a was qcow2, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:06:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:21 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1151692e-62b0-4468-bb54-260fb5eab900 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075" returned: 0 in 0.898s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:21 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 is being set with open permissions: ugo+rw Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:21 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:06:21 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:21 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 Jun 23 14:06:21 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:21 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0.999390c8-6aab-485c-9b20-a8733400a28c" returned: 0 in 0.783s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-999390c8-6aab-485c-9b20-a8733400a28c" released by "_delete_snapshot" :: held 3.659s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-a38d4436-f5d0-45c2-8958-d70164cc22d0" released by "delete_snapshot" :: held 3.689s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-2bd4ae10-1a97-4e23-aea8-33e899358761" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-2bd4ae10-1a97-4e23-aea8-33e899358761" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-a9d98c7d-66e3-4602-be3b-161325a413f4" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-a9d98c7d-66e3-4602-be3b-161325a413f4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Deleting offline snapshot a9d98c7d-66e3-4602-be3b-161325a413f4 of volume 2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] snapshot_file for this snap is: volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1593aec-b953-47af-9eeb-94b1f34b7b92]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:21 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 Jun 23 14:06:21 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:21 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075" returned: 0 in 0.838s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:21 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info Jun 23 14:06:21 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:22 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4" returned: 0 in 0.972s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bd4ae10-1a97-4e23-aea8-33e899358761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:06:22 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afdc900-5999-48ca-a64a-d369e42eb7a0]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:22 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 Jun 23 14:06:22 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:22 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info" returned: 0 in 0.900s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:22 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info is being set with open permissions: ugo+rw Jun 23 14:06:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:22 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info Jun 23 14:06:22 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:23 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761" returned: 0 in 0.968s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:23 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 0 in 2.382s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_179081e6-d234-49ab-bbc4-daebf318749a_tr8cs9ufdevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:06:23 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Converted 112.00 MB image at 46.97 MB/s Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:23 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 Jun 23 14:06:23 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:23 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 1G Jun 23 14:06:23 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:23 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.info" returned: 0 in 0.912s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.692s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.199s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1162970019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62e56f5-39d4-4b5b-9b92-2533508bd083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:05Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Creating volume c62e56f5-39d4-4b5b-9b92-2533508bd083 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:23 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:23 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 1073741824 Jun 23 14:06:23 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:23 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e3924a73-c435-4940-8985-96187b8bd46a tempest-VolumesSnapshotTestJSON-1451537270 None] Create snapshot completed successfully Jun 23 14:06:24 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 1G" returned: 0 in 0.865s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4090a06-c237-4fcf-a7b4-55d5402eb47c]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:24 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4" returned: 0 in 0.954s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:24 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4 Jun 23 14:06:24 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:24 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:06:24 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:24 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 1073741824" returned: 0 in 1.144s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (49e5a42f-1200-4fea-8968-a1cdf6e65523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35faf921-0bef-4dbe-a70e-2ef433021694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35faf921-0bef-4dbe-a70e-2ef433021694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1914992411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9580f7-e990-4506-ae0e-31af1e033b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0d056df584472fbda040961442052a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fe5a14e-984d-4ce2-903b-c254bb6dd075,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:25Z,use_quota=True,user_id='5398416ed4ea40b6b1fdf0a406759f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972c2f44-7673-4602-b662-4354072d34df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972c2f44-7673-4602-b662-4354072d34df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e091fd-5ce5-49ef-a3ce-a6f370aec7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e091fd-5ce5-49ef-a3ce-a6f370aec7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d9580f7-e990-4506-ae0e-31af1e033b5c', 'volume_name': 'volume-6d9580f7-e990-4506-ae0e-31af1e033b5c', 'volume_size': 1, 'snapshot_id': '3fe5a14e-984d-4ce2-903b-c254bb6dd075'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccf82e0-0382-44b9-bcf8-0898e1f4e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccf82e0-0382-44b9-bcf8-0898e1f4e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31bd220-4804-40cf-a383-d8749193e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Volume 6d9580f7-e990-4506-ae0e-31af1e033b5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d9580f7-e990-4506-ae0e-31af1e033b5c', 'volume_size': 1, 'snapshot_id': '3fe5a14e-984d-4ce2-903b-c254bb6dd075'} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:25 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 Jun 23 14:06:25 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:25 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761.a9d98c7d-66e3-4602-be3b-161325a413f4" returned: 0 in 0.923s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-a9d98c7d-66e3-4602-be3b-161325a413f4" released by "_delete_snapshot" :: held 3.958s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-2bd4ae10-1a97-4e23-aea8-33e899358761" released by "delete_snapshot" :: held 3.987s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:25 devstack cinder-volume[93605]: WARNING cinder.quota [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-888662701 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-888662701, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:06:25 devstack cinder-volume[93605]: WARNING cinder.quota [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-888662701 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-888662701, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:06:25 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['e92dd1dc-5a3b-4331-9a79-52657bd2e245', 'e5c6df15-0375-449c-b009-b5be839d93fc', '065d0879-39e4-4c13-88c8-9dfe6d2a88a6', '8eb0b0ac-eb39-4d7e-bfa3-dbae1cab2503'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 0 in 1.137s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:25 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:06:25 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['b055a067-c7b3-482f-abf5-283a1c871e8f', 'ccd64526-b2ec-4569-ace6-83a65de2c76f', '128c74a5-e9de-40e5-a69a-eea567832359', 'cc79d522-a40e-4360-9e6a-38d3151d7963'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:25 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-78fc2661-efa8-4292-a7f4-ef7b17c73775 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot bd41caf3-3ca6-4168-838a-ef326ae88f1f: deleted successfully Jun 23 14:06:25 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083" returned: 0 in 0.845s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.855s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-3fe5a14e-984d-4ce2-903b-c254bb6dd075-6d9580f7-e990-4506-ae0e-31af1e033b5c" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f2cd1-7e7d-4599-81d9-ecedc0a8aa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62e56f5-39d4-4b5b-9b92-2533508bd083', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b675f14-e5ac-46a2-b632-9817bd18ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3fe5a14e-984d-4ce2-903b-c254bb6dd075-6d9580f7-e990-4506-ae0e-31af1e033b5c" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Creating volume 6d9580f7-e990-4506-ae0e-31af1e033b5c from snapshot 3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-6d9580f7-e990-4506-ae0e-31af1e033b5c" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Volume volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 (c62e56f5-39d4-4b5b-9b92-2533508bd083): created successfully Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b675f14-e5ac-46a2-b632-9817bd18ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (21b337b0-c1fb-4265-bd59-579317b08060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-6d9580f7-e990-4506-ae0e-31af1e033b5c" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] snapshot: 3fe5a14e-984d-4ce2-903b-c254bb6dd075, volume: 6d9580f7-e990-4506-ae0e-31af1e033b5c, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:06:25 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-886e1684-7ca0-4239-bd8c-75b0c9f61d57 tempest-VolumesActionsTest-944139993 None] Created volume successfully. Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[70626470-058e-407a-9de4-f1ee420c46ee]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:26 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 Jun 23 14:06:26 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:26 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 1 in 0.984s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Downloaded image 179081e6-d234-49ab-bbc4-daebf318749a ((None, [{'url': 'file:///opt/stack/data/glance/images/179081e6-d234-49ab-bbc4-daebf318749a', 'metadata': {}}])) to volume 45d4e178-00b1-458a-a5b9-b3aaae7d8124 successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Temporary image 179081e6-d234-49ab-bbc4-daebf318749a for user 98e005181aaf403a9965c6652d2439da is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Marking volume 45d4e178-00b1-458a-a5b9-b3aaae7d8124 as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Copying metadata from image 179081e6-d234-49ab-bbc4-daebf318749a to 45d4e178-00b1-458a-a5b9-b3aaae7d8124. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Creating volume glance metadata for volume 45d4e178-00b1-458a-a5b9-b3aaae7d8124 backed by image 179081e6-d234-49ab-bbc4-daebf318749a with: {'image_id': '179081e6-d234-49ab-bbc4-daebf318749a', 'image_name': 'tempest-scenario-img--163357673', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bd0ed7-2f80-4667-9648-98021a5dab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124', 'volume_size': 1, 'image_id': '179081e6-d234-49ab-bbc4-daebf318749a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/179081e6-d234-49ab-bbc4-daebf318749a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--163357673', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7f2d79d314234b0c9527c8e1e4cd1930', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '179081e6-d234-49ab-bbc4-daebf318749a', 'created_at': datetime.datetime(2026, 6, 23, 12, 5, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 5, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/179081e6-d234-49ab-bbc4-daebf318749a/file', 'properties': {}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d223390-6eaf-4512-b9d1-1824848b1090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:26 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Volume volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 (45d4e178-00b1-458a-a5b9-b3aaae7d8124): created successfully Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d223390-6eaf-4512-b9d1-1824848b1090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Flow 'volume_create_manager' (74951aba-133e-4ba8-b8e4-849d235e24a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-00732d42-c4f5-4813-a89f-951a6c3b2057 tempest-TestInstancesWithCinderVolumes-1629233990 None] Created volume successfully. Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-2bd4ae10-1a97-4e23-aea8-33e899358761" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-2bd4ae10-1a97-4e23-aea8-33e899358761" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:26 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075" returned: 0 in 0.950s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1151692e-62b0-4468-bb54-260fb5eab900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:06:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca82768-4ec5-4ab2-b72e-5f4d269155d4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95b91c8-2fdc-4d12-b74d-ae0ee66a6fd9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:27 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 Jun 23 14:06:27 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:27 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:27 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-c62e56f5-39d4-4b5b-9b92-2533508bd083-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Lock "cinder-c62e56f5-39d4-4b5b-9b92-2533508bd083-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Acquiring lock "cinder-quobyte-c62e56f5-39d4-4b5b-9b92-2533508bd083" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-c62e56f5-39d4-4b5b-9b92-2533508bd083" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05d31dd-70df-40de-b7fc-56fd90ca6e7a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:27 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 Jun 23 14:06:27 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:27 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761" returned: 0 in 0.935s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:27 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761 Jun 23 14:06:27 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:28 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 1.028s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:28 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c Jun 23 14:06:28 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:28 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083" returned: 0 in 1.093s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:28 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083 Jun 23 14:06:28 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:28 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2bd4ae10-1a97-4e23-aea8-33e899358761" returned: 0 in 0.796s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-2bd4ae10-1a97-4e23-aea8-33e899358761" released by "delete_volume" :: held 1.838s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-a38d4436-f5d0-45c2-8958-d70164cc22d0" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-a38d4436-f5d0-45c2-8958-d70164cc22d0" acquired by "delete_volume" :: waited 0.015s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a44534-4ce5-4184-8503-aa57721ab912]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:28 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 Jun 23 14:06:28 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:30 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c62e56f5-39d4-4b5b-9b92-2533508bd083" returned: 0 in 1.692s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Lock "cinder-quobyte-c62e56f5-39d4-4b5b-9b92-2533508bd083" released by "delete_volume" :: held 2.850s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Created reservations ['e4c5d39f-4baf-4f03-b003-75e66371a8a8', '85b9f4ac-fb5f-41ee-853c-9e22de5b4c49', 'c4267a90-0a3c-4bab-bd11-03a3812a19c5', 'ad99a149-a53a-4773-b5b6-dd436d6c75f9'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:30 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:30 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:31 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0" returned: 0 in 2.621s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:31 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0 Jun 23 14:06:31 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=122,cinder:SELECT=122,cinder:INSERT=33,cinder:DELETE=11 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (5e8073a2-7f3e-4411-8726-2c7e1b5047c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:32 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413914c8-2663-4e90-8c42-648f088a2e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 2.021s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413914c8-2663-4e90-8c42-648f088a2e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441179832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c5686b-3e04-4bb3-a783-8e462fa837e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:32Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1980d1ad-342f-434c-a3c0-980f9d5864f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1980d1ad-342f-434c-a3c0-980f9d5864f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce602215-5375-425a-82eb-1a76c4af2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce602215-5375-425a-82eb-1a76c4af2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c5686b-3e04-4bb3-a783-8e462fa837e4', 'volume_name': 'volume-93c5686b-3e04-4bb3-a783-8e462fa837e4', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cca19c1-20ba-42ab-98ce-73a6ebc4a3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cca19c1-20ba-42ab-98ce-73a6ebc4a3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3c376d-c842-473d-9a5e-27a8c6c60deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:32 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Volume 93c5686b-3e04-4bb3-a783-8e462fa837e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c5686b-3e04-4bb3-a783-8e462fa837e4', 'volume_size': 1} Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Deleted volume successfully. Jun 23 14:06:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b0c01969-9f9a-4342-a624-81953c5448a1 tempest-VolumesActionsTest-169356233 None] Lock "cinder-c62e56f5-39d4-4b5b-9b92-2533508bd083-delete_volume" released by "delete_volume" :: held 5.550s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:33 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a38d4436-f5d0-45c2-8958-d70164cc22d0" returned: 0 in 2.267s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-a38d4436-f5d0-45c2-8958-d70164cc22d0" released by "delete_volume" :: held 5.020s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:33 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['b5cf448d-ce9b-4e57-96c5-b7e576ed6569'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:34 devstack cinder-volume[93605]: WARNING cinder.quota [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-888662701 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-888662701, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['23dbf43e-a558-42d2-9295-e9bfb0ad6baa', 'e8359ca1-dfba-4c92-b10c-08005cea9ce3', '6696b6dc-28e3-4bc1-b3a6-0912849f3cd5', '46d381f3-a8ea-4b1c-9692-d7aac5ee8e94'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['6d175d70-cf5a-4398-95d7-9055e13337d1', '4bc0cc51-7e50-4abe-82f8-a15700b20c68', '1504bb78-05d8-48ee-9961-2ce7ec73d133', '90b80843-8c3a-49b9-ad79-1636f89a4b37'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:34 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:34 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:35 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c" returned: 0 in 7.649s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48e6a1-45af-448c-8a4e-809e1fff9131]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:35 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:35 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:35 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.062s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:35 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b3cf84a3-432d-43cf-8d49-e354c82e9186 tempest-GroupSnapshotsTest-1328288680 None] Delete group completed successfully. Jun 23 14:06:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-687683a3-9ff0-433c-b60f-1c2441b73f6b tempest-GroupSnapshotsTest-1328288680 None] Group tempest-GroupSnapshotsTest-Group-1145237690: creating Jun 23 14:06:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-687683a3-9ff0-433c-b60f-1c2441b73f6b tempest-GroupSnapshotsTest-1328288680 None] Group tempest-GroupSnapshotsTest-Group-1145237690: created successfully Jun 23 14:06:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-687683a3-9ff0-433c-b60f-1c2441b73f6b tempest-GroupSnapshotsTest-1328288680 None] Create group completed successfully. Jun 23 14:06:36 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 1.093s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:36 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:06:36 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Converted 1024.00 MB image at 133.85 MB/s Jun 23 14:06:36 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c is being set with open permissions: ugo+rw Jun 23 14:06:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:36 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c Jun 23 14:06:36 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:37 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c" returned: 0 in 1.125s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-6d9580f7-e990-4506-ae0e-31af1e033b5c" released by "_copy_volume_from_snapshot" :: held 11.977s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3fe5a14e-984d-4ce2-903b-c254bb6dd075-6d9580f7-e990-4506-ae0e-31af1e033b5c" released by "_create_volume_from_snapshot" :: held 12.042s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.082s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.262s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441179832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c5686b-3e04-4bb3-a783-8e462fa837e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f66f65bf834b16ba0441312088dc30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:32Z,use_quota=True,user_id='30f9d092fa964cdaa996429ce25ba111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Creating volume 93c5686b-3e04-4bb3-a783-8e462fa837e4 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:37 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:38 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 1073741824 Jun 23 14:06:38 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31bd220-4804-40cf-a383-d8749193e116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9580f7-e990-4506-ae0e-31af1e033b5c', 'volume_size': 1, 'snapshot_id': '3fe5a14e-984d-4ce2-903b-c254bb6dd075'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a930865d-c4c0-4fbe-8c00-7f51c2684549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (b0091ef2-10b1-4cdb-ba57-da871d239862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504cfc1e-a8d3-4673-acb6-8d48b954b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Volume volume-6d9580f7-e990-4506-ae0e-31af1e033b5c (6d9580f7-e990-4506-ae0e-31af1e033b5c): created successfully Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a930865d-c4c0-4fbe-8c00-7f51c2684549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Flow 'volume_create_manager' (49e5a42f-1200-4fea-8968-a1cdf6e65523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504cfc1e-a8d3-4673-acb6-8d48b954b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-586470417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb4875f6-a102-48ea-84f1-045c5522119b,host='devstack@QuobyteHD#QuobyteHD',id=3ddcfdfc-13aa-42ce-a249-d48c3feede16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:38Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bf0b73-3bfe-4c65-81c6-e00e74aa1a7f),volume_type_id=01bf0b73-3bfe-4c65-81c6-e00e74aa1a7f)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8711e0c-81ae-449c-bc20-dfc363584b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8711e0c-81ae-449c-bc20-dfc363584b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57398ba-252a-45e0-bed4-1ee8b9e514ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57398ba-252a-45e0-bed4-1ee8b9e514ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddcfdfc-13aa-42ce-a249-d48c3feede16', 'volume_name': 'volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef20061-1285-49b3-94eb-6adbdb7918e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef20061-1285-49b3-94eb-6adbdb7918e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975d99d6-b1e4-4451-837a-e8dfdd706806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Volume 3ddcfdfc-13aa-42ce-a249-d48c3feede16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16', 'volume_size': 1} Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c86f890c-20d9-4e04-88c3-da00e4cbda3a tempest-VolumesSnapshotTestJSON-1451537270 None] Created volume successfully. Jun 23 14:06:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-6d9580f7-e990-4506-ae0e-31af1e033b5c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-6d9580f7-e990-4506-ae0e-31af1e033b5c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:39 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 1073741824" returned: 0 in 1.288s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-6d9580f7-e990-4506-ae0e-31af1e033b5c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-6d9580f7-e990-4506-ae0e-31af1e033b5c" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eecbe8b-b69c-45fe-8b6e-0aad7510b50b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:39 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 Jun 23 14:06:39 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:39 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c Jun 23 14:06:39 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:40 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4" returned: 0 in 0.795s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb4875f6-a102-48ea-84f1-045c5522119b,created_at=2026-06-23T12:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-586470417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb4875f6-a102-48ea-84f1-045c5522119b,host='devstack@QuobyteHD#QuobyteHD',id=3ddcfdfc-13aa-42ce-a249-d48c3feede16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66178d88edc34d1e8e570a9d95366004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:06:38Z,use_quota=True,user_id='6c6799e7aeae4825b9f807698b87a50c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bf0b73-3bfe-4c65-81c6-e00e74aa1a7f),volume_type_id=01bf0b73-3bfe-4c65-81c6-e00e74aa1a7f)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Creating volume 3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:06:40 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:40 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 1073741824 Jun 23 14:06:40 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3c376d-c842-473d-9a5e-27a8c6c60deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c5686b-3e04-4bb3-a783-8e462fa837e4', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bb3783-ff28-4ee3-a2fe-7fa9cb33f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:40 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Volume volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 (93c5686b-3e04-4bb3-a783-8e462fa837e4): created successfully Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bb3783-ff28-4ee3-a2fe-7fa9cb33f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Flow 'volume_create_manager' (5e8073a2-7f3e-4411-8726-2c7e1b5047c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8e3d295b-449c-4b34-aaff-6d508e9c7e36 tempest-VolumesActionsTest-944139993 None] Created volume successfully. Jun 23 14:06:40 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c" returned: 0 in 0.951s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:40 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c Jun 23 14:06:40 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:41 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6d9580f7-e990-4506-ae0e-31af1e033b5c" returned: 0 in 0.893s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-6d9580f7-e990-4506-ae0e-31af1e033b5c" released by "delete_volume" :: held 1.918s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:41 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 1073741824" returned: 0 in 1.138s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['eac25b12-1630-4fea-9f26-a16966d12a71', 'f275b60d-8a96-4211-a931-9285ffe714b3', 'fc21bb8d-8817-4bd0-aae2-8c1ccbddd1ae', 'ea6eac5c-bc07-4a75-9d45-78f2d5638dc0'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:41 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 Jun 23 14:06:41 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:41 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:41 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Acquiring lock "cinder-93c5686b-3e04-4bb3-a783-8e462fa837e4-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Lock "cinder-93c5686b-3e04-4bb3-a783-8e462fa837e4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-3fe5a14e-984d-4ce2-903b-c254bb6dd075-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Acquiring lock "cinder-quobyte-93c5686b-3e04-4bb3-a783-8e462fa837e4" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-3fe5a14e-984d-4ce2-903b-c254bb6dd075-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-1151692e-62b0-4468-bb54-260fb5eab900" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Lock "cinder-quobyte-93c5686b-3e04-4bb3-a783-8e462fa837e4" acquired by "delete_volume" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-1151692e-62b0-4468-bb54-260fb5eab900" acquired by "delete_snapshot" :: waited 0.074s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-3fe5a14e-984d-4ce2-903b-c254bb6dd075" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f60675-89d1-4046-94ff-9f3206126198]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3fe5a14e-984d-4ce2-903b-c254bb6dd075" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Deleting offline snapshot 3fe5a14e-984d-4ce2-903b-c254bb6dd075 of volume 1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:06:41 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] snapshot_file for this snap is: volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7732f6-d16a-4b69-b2bd-ea2c039d9bef]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:42 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 Jun 23 14:06:42 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:42 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 Jun 23 14:06:42 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:42 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16" returned: 0 in 1.210s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.430s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.989s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:42 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.174s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975d99d6-b1e4-4451-837a-e8dfdd706806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0222b988-89ef-4043-b09f-b9f789a78d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:06:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Deleted volume successfully. Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f9b6e6-d1f6-4bf1-83f9-99508f167c10]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:42 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Volume volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 (3ddcfdfc-13aa-42ce-a249-d48c3feede16): created successfully Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0222b988-89ef-4043-b09f-b9f789a78d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Flow 'volume_create_manager' (b0091ef2-10b1-4cdb-ba57-da871d239862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:06:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7c1c3ef4-52b5-45b5-a917-fea4cda56e03 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-6d9580f7-e990-4506-ae0e-31af1e033b5c-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f7c275d7-6617-45d5-b8e9-238f0543403e tempest-GroupSnapshotsTest-1328288680 None] Created volume successfully. Jun 23 14:06:42 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:06:42 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:43 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4" returned: 0 in 1.128s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:43 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4 Jun 23 14:06:43 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:43 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075" returned: 0 in 1.308s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1151692e-62b0-4468-bb54-260fb5eab900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f21523-96a1-44da-aa33-47974c04aa70]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:43 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:43 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] GroupSnapshot 36f8ee8d-6fac-40f4-bd90-5a4595632bd2: creating. Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Group snapshot 36f8ee8d-6fac-40f4-bd90-5a4595632bd2: creating. {{(pid=93605) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:43 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 0 in 1.036s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:43 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:06:43 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:43 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-93c5686b-3e04-4bb3-a783-8e462fa837e4" returned: 0 in 0.879s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Lock "cinder-quobyte-93c5686b-3e04-4bb3-a783-8e462fa837e4" released by "delete_volume" :: held 2.119s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Created reservations ['2617fd8e-ada2-4d14-ab7c-072aacab1266', '7c34aef6-ec4d-4cfc-a7d0-9da8a56e4587', 'ef9e934d-115a-4275-b042-2e1908a82d7d', 'fcc81407-aa0a-4aa2-af92-575fd55088b0'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:44 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:44 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:44 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 1.176s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:44 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 Jun 23 14:06:44 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:44 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 1 in 0.987s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.126s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.046s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Creating offline snapshot c251494e-de12-4d2b-9a26-ba1d83b32e11 of volume 3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[247bbe59-8d91-45a8-8c57-465e7ab18f08]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54e061cb-e7d5-4e5a-b3b4-9450bb6e94a9', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:06:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-2ceabf35-fbc6-4c6a-abae-8b95a0d42002 req-a0821e1e-1b24-4782-bd64-8564984cc5d5 tempest-TestInstancesWithCinderVolumes-1629233990 None] attachment_update completed successfully. Jun 23 14:06:44 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 Jun 23 14:06:44 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:44 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.833s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:44 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Deleted volume successfully. Jun 23 14:06:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-38f2543d-bd52-4fe1-a539-8a1327c0c156 tempest-VolumesActionsTest-944139993 None] Lock "cinder-93c5686b-3e04-4bb3-a783-8e462fa837e4-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:45 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075" returned: 0 in 1.035s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:45 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075 Jun 23 14:06:45 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:45 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16" returned: 0 in 1.107s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:45 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 1G Jun 23 14:06:45 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:46 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900.3fe5a14e-984d-4ce2-903b-c254bb6dd075" returned: 0 in 0.838s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3fe5a14e-984d-4ce2-903b-c254bb6dd075" released by "_delete_snapshot" :: held 4.549s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-1151692e-62b0-4468-bb54-260fb5eab900" released by "delete_snapshot" :: held 4.601s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:46 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['7472bf51-a2fe-4838-a2ae-5da1e748164f', 'a396064a-20e2-43a9-a826-9f982045c8ad', '1955f019-955c-46ed-a2a2-bb1a300e2f3d', 'b0b71fe5-e568-43ca-a312-f7e5aacebcdb'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Delete snapshot completed successfully. Jun 23 14:06:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2b186f5-60f8-4445-b211-aaae56e2c42e tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-3fe5a14e-984d-4ce2-903b-c254bb6dd075-delete_snapshot" released by "delete_snapshot" :: held 4.862s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:47 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 1G" returned: 0 in 1.150s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:47 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 Jun 23 14:06:47 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-1151692e-62b0-4468-bb54-260fb5eab900-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-1151692e-62b0-4468-bb54-260fb5eab900-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-1151692e-62b0-4468-bb54-260fb5eab900" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-1151692e-62b0-4468-bb54-260fb5eab900" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[54513779-5d62-4a52-b30e-48a60b2ee9f2]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:47 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:47 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:48 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11" returned: 0 in 0.990s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:48 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:06:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:48 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 Jun 23 14:06:48 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:48 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 1.046s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:48 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900 Jun 23 14:06:48 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:49 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11" returned: 0 in 0.979s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:49 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info Jun 23 14:06:49 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:49 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1151692e-62b0-4468-bb54-260fb5eab900" returned: 0 in 0.982s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-1151692e-62b0-4468-bb54-260fb5eab900" released by "delete_volume" :: held 2.111s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:49 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['0d7820e1-3956-4599-972f-353582d01190', 'fb034665-0094-40ef-8cd6-7c3362c5c7e8', '6f9e1e93-7474-4c57-92dc-c15af93dad31', '545bc1b6-8b64-46c5-af6d-5763ef0afc8a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:50 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:50 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:50 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info" returned: 0 in 1.191s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:50 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 14:06:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:50 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info Jun 23 14:06:50 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:51 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.135s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Deleted volume successfully. Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2e80f40d-dcb3-4490-8f8c-f447d2119eae tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-1151692e-62b0-4468-bb54-260fb5eab900-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:51 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.info" returned: 0 in 1.273s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.854s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:51 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:51 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "cinder-quobyte-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" acquired by "delete_volume" :: waited 0.042s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a881274a-f2e9-47e1-aa5e-3acc2d0b897e tempest-GroupSnapshotsTest-1328288680 None] group_snapshot 36f8ee8d-6fac-40f4-bd90-5a4595632bd2: created successfully Jun 23 14:06:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a86d2ad-6cda-48f7-a1f4-300465c4f202]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:52 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba Jun 23 14:06:52 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot 36f8ee8d-6fac-40f4-bd90-5a4595632bd2: deleting Jun 23 14:06:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot 36f8ee8d-6fac-40f4-bd90-5a4595632bd2: deleting {{(pid=93605) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-3ddcfdfc-13aa-42ce-a249-d48c3feede16" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-3ddcfdfc-13aa-42ce-a249-d48c3feede16" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-c251494e-de12-4d2b-9a26-ba1d83b32e11" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-c251494e-de12-4d2b-9a26-ba1d83b32e11" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Deleting offline snapshot c251494e-de12-4d2b-9a26-ba1d83b32e11 of volume 3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] snapshot_file for this snap is: volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e75d5-a34f-4c47-9775-a242b54d6c6d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:53 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.786s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:06:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:06:53 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 Jun 23 14:06:53 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:54 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" returned: 0 in 2.057s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:54 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba Jun 23 14:06:54 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:54 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11" returned: 0 in 1.661s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:06:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4629697b-c8ba-41bd-9879-c3ef47a4c8fd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:06:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:55 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 Jun 23 14:06:55 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:55 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" returned: 0 in 1.328s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-quobyte-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba" released by "delete_volume" :: held 3.567s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Created reservations ['b8ee4b15-b53e-458a-a3f2-1f90a0f51268', '499a9668-9841-4aa5-97ea-491323e51dee', 'b57bd0fd-000c-48fe-a781-bc5fe77856f4', 'f9ae6899-2ad9-45d0-a072-0f6bf757c882'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:06:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:55 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:06:55 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:56 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16" returned: 0 in 1.800s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:56 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 Jun 23 14:06:56 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:56 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.222s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:56 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:06:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Deleted volume successfully. Jun 23 14:06:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-74361bcb-01c1-48d3-a094-9b1674b84422 tempest-VolumesSnapshotTestJSON-1451537270 None] Lock "cinder-3cc8ea3b-7dc1-4ab7-b573-f886b5c9dbba-delete_volume" released by "delete_volume" :: held 5.290s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:58 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11" returned: 0 in 1.658s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:06:58 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11 Jun 23 14:06:58 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:06:59 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 23 14:06:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16.c251494e-de12-4d2b-9a26-ba1d83b32e11" returned: 0 in 1.110s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:06:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-c251494e-de12-4d2b-9a26-ba1d83b32e11" released by "_delete_snapshot" :: held 6.487s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-3ddcfdfc-13aa-42ce-a249-d48c3feede16" released by "delete_snapshot" :: held 6.540s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:06:59 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=146,cinder:SELECT=128,cinder:INSERT=39,cinder:DELETE=8 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:06:59 devstack cinder-volume[93605]: WARNING cinder.quota [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-57141080 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-57141080, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:06:59 devstack cinder-volume[93605]: WARNING cinder.quota [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-57141080 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-57141080, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:06:59 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['0f972109-5e21-47f5-893a-23f9b959af81', 'a4795c01-b556-4545-9373-1a0a3f1b1ee5', '563001f1-db38-475f-b22b-f88db121441a', 'f5a49b28-cd0f-4826-8270-6cd7f6d42218'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:06:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-eb20e6da-87f1-4fd6-b8ee-ee08891fe7f8 tempest-GroupSnapshotsTest-1328288680 None] group_snapshot 36f8ee8d-6fac-40f4-bd90-5a4595632bd2: deleted successfully Jun 23 14:07:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "cinder-quobyte-3ddcfdfc-13aa-42ce-a249-d48c3feede16" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-3ddcfdfc-13aa-42ce-a249-d48c3feede16" acquired by "delete_volume" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:00 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2a8f21-a58b-44ef-962e-cf7a433421d3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:00 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 Jun 23 14:07:00 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:02 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16" returned: 0 in 1.443s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:02 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16 Jun 23 14:07:02 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:03 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3ddcfdfc-13aa-42ce-a249-d48c3feede16" returned: 0 in 1.613s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Lock "cinder-quobyte-3ddcfdfc-13aa-42ce-a249-d48c3feede16" released by "delete_volume" :: held 3.216s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['9fb87504-5d94-48fd-8d55-1add582348d2'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:04 devstack cinder-volume[93605]: WARNING cinder.quota [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-57141080 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-57141080, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Created reservations ['e5f83b6a-0290-4aa4-ace9-7249df65a78e', '616a428c-7ddc-4921-aef5-0d02d33bf35f', 'c901ab91-68fb-4cfb-acd2-b63b15903027', '27101315-70ac-446a-8f30-b8984081cd93'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:04 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:07:04 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:06 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.612s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:06 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:06 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-475c93ba-a667-4447-8fec-c07e5ddfb898 tempest-GroupSnapshotsTest-1328288680 None] Delete group completed successfully. Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Flow 'volume_create_manager' (40158979-247d-482b-828c-e415856f0c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009cc004-0df8-46a9-b4af-4a3f80c2ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009cc004-0df8-46a9-b4af-4a3f80c2ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-539231036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9bb254-06e5-492b-a8d5-80dea8ee6791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f054555fe14a05a77258a248fca4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:13Z,use_quota=True,user_id='3404e038fed84529b8ec7183a9622e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df91f7b-05b1-4cf1-8e24-a3c9f0a748e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df91f7b-05b1-4cf1-8e24-a3c9f0a748e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a663f6ab-9cb2-4efa-be6b-e732509a7f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a663f6ab-9cb2-4efa-be6b-e732509a7f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9bb254-06e5-492b-a8d5-80dea8ee6791', 'volume_name': 'volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385feb62-9467-4b03-a626-47236e736283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385feb62-9467-4b03-a626-47236e736283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c737d18-6ca5-46e4-86e1-9005a658bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Volume bd9bb254-06e5-492b-a8d5-80dea8ee6791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791', 'volume_size': 1} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-539231036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9bb254-06e5-492b-a8d5-80dea8ee6791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f054555fe14a05a77258a248fca4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:13Z,use_quota=True,user_id='3404e038fed84529b8ec7183a9622e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Creating volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:13 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:13 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 1073741824 Jun 23 14:07:13 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Flow 'volume_create_manager' (19232a25-4c7d-4e13-9721-0c7a2381631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8feefec3-2878-4c24-9616-3e8b70642132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8feefec3-2878-4c24-9616-3e8b70642132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-123298588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2adbbc79-5819-4b78-8293-32efccff73d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17e5335d8b544098a0d9f8b8f0b2d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:14Z,use_quota=True,user_id='df6591e332f247d09a83c9867bdcb86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b81f03-d133-4101-8e5f-72987141517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b81f03-d133-4101-8e5f-72987141517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e97d021-048b-4164-b20f-8200cde54991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e97d021-048b-4164-b20f-8200cde54991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2adbbc79-5819-4b78-8293-32efccff73d5', 'volume_name': 'volume-2adbbc79-5819-4b78-8293-32efccff73d5', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3997a6c8-742f-4016-91f7-b8bd5598c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3997a6c8-742f-4016-91f7-b8bd5598c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db56a70-d297-4983-86a6-0e8c8f11e9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:13 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Volume 2adbbc79-5819-4b78-8293-32efccff73d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2adbbc79-5819-4b78-8293-32efccff73d5', 'volume_size': 1} Jun 23 14:07:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:14 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 1073741824" returned: 0 in 1.076s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:14 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 Jun 23 14:07:14 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:15 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791" returned: 0 in 0.824s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-123298588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2adbbc79-5819-4b78-8293-32efccff73d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17e5335d8b544098a0d9f8b8f0b2d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:14Z,use_quota=True,user_id='df6591e332f247d09a83c9867bdcb86a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Creating volume 2adbbc79-5819-4b78-8293-32efccff73d5 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:15 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:15 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 1073741824 Jun 23 14:07:15 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c737d18-6ca5-46e4-86e1-9005a658bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211e99f8-af1f-4623-8816-7e020eef4b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:15 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Volume volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 (bd9bb254-06e5-492b-a8d5-80dea8ee6791): created successfully Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211e99f8-af1f-4623-8816-7e020eef4b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Flow 'volume_create_manager' (40158979-247d-482b-828c-e415856f0c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fe98e5be-9dab-4ebe-b93a-24aedfcb1896 tempest-VolumesSnapshotListTestJSON-320262722 None] Created volume successfully. Jun 23 14:07:16 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 1073741824" returned: 0 in 1.098s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:16 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 Jun 23 14:07:16 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:17 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5" returned: 0 in 0.845s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.812s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db56a70-d297-4983-86a6-0e8c8f11e9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2adbbc79-5819-4b78-8293-32efccff73d5', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0687d7d1-453f-486a-9149-f605cafd9d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Creating offline snapshot d5a12266-05fb-41e5-b971-5582120dba6a of volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:07:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Volume volume-2adbbc79-5819-4b78-8293-32efccff73d5 (2adbbc79-5819-4b78-8293-32efccff73d5): created successfully Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0687d7d1-453f-486a-9149-f605cafd9d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Flow 'volume_create_manager' (19232a25-4c7d-4e13-9721-0c7a2381631a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c3f22-da56-47fa-8f08-973ae06e3681]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5e850f4f-f743-44b0-9741-5de060917fd9 tempest-AbsoluteLimitsTests-1740905903 None] Created volume successfully. Jun 23 14:07:17 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 Jun 23 14:07:17 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:18 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791" returned: 0 in 1.049s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:18 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a 1G Jun 23 14:07:18 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Acquiring lock "cinder-2adbbc79-5819-4b78-8293-32efccff73d5-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Lock "cinder-2adbbc79-5819-4b78-8293-32efccff73d5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Acquiring lock "cinder-quobyte-2adbbc79-5819-4b78-8293-32efccff73d5" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Lock "cinder-quobyte-2adbbc79-5819-4b78-8293-32efccff73d5" acquired by "delete_volume" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245f385-99f0-46b7-aa25-0a2b81472003]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:19 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 Jun 23 14:07:19 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:20 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a 1G" returned: 0 in 1.376s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:20 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:20 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:20 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5" returned: 0 in 1.217s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:20 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5 Jun 23 14:07:20 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:21 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 1.332s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:21 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a is being set with open permissions: ugo+rw Jun 23 14:07:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:21 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:21 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:21 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-2adbbc79-5819-4b78-8293-32efccff73d5" returned: 0 in 1.192s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Lock "cinder-quobyte-2adbbc79-5819-4b78-8293-32efccff73d5" released by "delete_volume" :: held 2.486s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:21 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Created reservations ['6589c726-9642-48a7-8b0b-f7874c6105bf', 'c48f0ed8-a199-4850-aee4-621a5c791e01', '99610dfd-0ae5-4706-96ae-295a6a48d65a', 'c763efc8-d130-4056-8e4a-4459551663a7'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:22 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:07:22 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:22 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 1.044s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:22 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info Jun 23 14:07:22 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:23 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.187s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:23 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:23 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Deleted volume successfully. Jun 23 14:07:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c455a7ac-2ce8-4275-ae0d-ddb1f47f8bff tempest-AbsoluteLimitsTests-1740905903 None] Lock "cinder-2adbbc79-5819-4b78-8293-32efccff73d5-delete_volume" released by "delete_volume" :: held 4.043s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:23 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:23 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info is being set with open permissions: ugo+rw Jun 23 14:07:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:23 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info Jun 23 14:07:23 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:24 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.info" returned: 0 in 1.051s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.150s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-02b13508-f00a-4be3-a957-302c9053e9f6 tempest-VolumesSnapshotListTestJSON-320262722 None] Create snapshot completed successfully Jun 23 14:07:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Creating offline snapshot a34c937d-a352-4609-adbd-3929df9d0378 of volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:07:25 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e4e585-a365-44c9-b428-44de635373b4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:25 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:25 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:26 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 1.021s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:26 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 1G Jun 23 14:07:26 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:27 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 1G" returned: 0 in 1.177s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:27 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:27 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:28 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 0.852s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:28 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 is being set with open permissions: ugo+rw Jun 23 14:07:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:28 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:28 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:29 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Flow 'volume_create_manager' (df9ccf11-729d-42bc-a664-9d58ef7d7640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cffc7e0-f275-44f9-8e6d-e10679dcff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 0.845s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cffc7e0-f275-44f9-8e6d-e10679dcff91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-163244071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896e215d-3e77-443d-983a-1d379e1e1ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ec89e755b497484582ba946e59a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:30Z,use_quota=True,user_id='b597213f2aa94118ae3a307e1e545743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b8f29d-06aa-434e-bb23-be45e3deb65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b8f29d-06aa-434e-bb23-be45e3deb65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c545a6ef-cba8-49ae-9e98-a96eeb29ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c545a6ef-cba8-49ae-9e98-a96eeb29ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896e215d-3e77-443d-983a-1d379e1e1ba3', 'volume_name': 'volume-896e215d-3e77-443d-983a-1d379e1e1ba3', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993a84de-c6c0-416a-a94c-924894623cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993a84de-c6c0-416a-a94c-924894623cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de47c1d7-6636-49de-b01f-0ec766ef09b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:29 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Volume 896e215d-3e77-443d-983a-1d379e1e1ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896e215d-3e77-443d-983a-1d379e1e1ba3', 'volume_size': 1} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.168s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.671s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b54ec4-cfbc-466a-ab6f-a903225ab835]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1e110023-2880-4153-8fcb-eff23e287c84 tempest-VolumesSnapshotListTestJSON-320262722 None] Create snapshot completed successfully Jun 23 14:07:29 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 Jun 23 14:07:29 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:30 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569" returned: 0 in 1.047s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.076s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-163244071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896e215d-3e77-443d-983a-1d379e1e1ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ec89e755b497484582ba946e59a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:30Z,use_quota=True,user_id='b597213f2aa94118ae3a307e1e545743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Creating volume 896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:30 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:30 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 1073741824 Jun 23 14:07:30 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-c08149ff-a574-45cc-9ce9-78ec746e8569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c5d59d5-370e-4d1f-a7be-68f1a8d39c52', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:07:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-8687f03d-9433-46c5-ba5f-1cd54e630d01 req-069b7a68-3ba4-448e-8ac2-6257d696e175 tempest-TestInstancesWithCinderVolumes-1629233990 None] attachment_update completed successfully. Jun 23 14:07:31 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 1073741824" returned: 0 in 1.103s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:32 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 Jun 23 14:07:32 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:32 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3" returned: 0 in 0.896s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.522s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=90,cinder:UPDATE=104,cinder:INSERT=25,cinder:DELETE=5 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de47c1d7-6636-49de-b01f-0ec766ef09b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896e215d-3e77-443d-983a-1d379e1e1ba3', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2adac0d7-5e7e-4be2-aebc-8fa5d20022e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Creating offline snapshot b661753d-d772-4940-a2c7-48f11e91a1db of volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:07:33 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Volume volume-896e215d-3e77-443d-983a-1d379e1e1ba3 (896e215d-3e77-443d-983a-1d379e1e1ba3): created successfully Jun 23 14:07:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2adac0d7-5e7e-4be2-aebc-8fa5d20022e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Flow 'volume_create_manager' (df9ccf11-729d-42bc-a664-9d58ef7d7640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb9ba7f-8aa8-4186-8487-a4e4b86cd533]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b1b444a7-032d-44e5-b255-c8c00452f0c7 tempest-VolumesDeleteCascade-1563062168 None] Created volume successfully. Jun 23 14:07:33 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:33 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:34 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 1.084s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:34 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db 1G Jun 23 14:07:34 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:35 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db 1G" returned: 0 in 1.101s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:35 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db Jun 23 14:07:35 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:36 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:36 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db is being set with open permissions: ugo+rw Jun 23 14:07:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:36 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db Jun 23 14:07:36 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:37 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db" returned: 0 in 0.775s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.216s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.454s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Creating offline snapshot fc787f98-0146-4aa9-84a4-99e002fbeac4 of volume 896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:07:37 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-28a729ad-6053-403b-9dc9-b4c7f4d8ae85 tempest-VolumesSnapshotListTestJSON-320262722 None] Create snapshot completed successfully Jun 23 14:07:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c4a1d-99cc-45a1-8aa6-e1948b6f6554]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:37 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 Jun 23 14:07:37 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:38 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3" returned: 0 in 0.898s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:38 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 1G Jun 23 14:07:38 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-b661753d-d772-4940-a2c7-48f11e91a1db-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-b661753d-d772-4940-a2c7-48f11e91a1db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-b661753d-d772-4940-a2c7-48f11e91a1db" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-b661753d-d772-4940-a2c7-48f11e91a1db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Deleting offline snapshot b661753d-d772-4940-a2c7-48f11e91a1db of volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] snapshot_file for this snap is: volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af6796-5caf-49e9-9e45-a8c0dd250815]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:38 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db Jun 23 14:07:38 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:39 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 1G" returned: 0 in 1.235s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896e215d-3e77-443d-983a-1d379e1e1ba3 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:39 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896e215d-3e77-443d-983a-1d379e1e1ba3 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:39 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:39 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db" returned: 0 in 1.096s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[216023cb-ca83-41fd-b022-191187256e96]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:40 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:40 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:40 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896e215d-3e77-443d-983a-1d379e1e1ba3 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 1.007s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:40 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 is being set with open permissions: ugo+rw Jun 23 14:07:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:40 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:40 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:40 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 1.036s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:41 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db Jun 23 14:07:41 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:41 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 0.825s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:41 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info Jun 23 14:07:41 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:42 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:42 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db" returned: 0 in 1.097s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info" returned: 0 in 0.877s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:42 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info is being set with open permissions: ugo+rw Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:42 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db Jun 23 14:07:42 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:42 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info Jun 23 14:07:42 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:42 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.info" returned: 0 in 0.766s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:42 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.770s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.090s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.b661753d-d772-4940-a2c7-48f11e91a1db" returned: 0 in 0.826s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f80c09-6aa2-4f6d-a167-2fca7775739c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-b661753d-d772-4940-a2c7-48f11e91a1db" released by "_delete_snapshot" :: held 4.213s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" released by "delete_snapshot" :: held 4.251s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2cfa4988-2eb2-4bb1-9798-3571d46ddb62 tempest-VolumesDeleteCascade-1563062168 None] Create snapshot completed successfully Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Created reservations ['276c697a-8cdb-46a4-848b-556956773481', 'ad684a34-f8ff-4c09-bcf1-49eb63bddcca', '1b5185dd-584b-40fe-b997-a55bd627f614', '0c892f13-49d8-4e44-88dc-3525273e4d72'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:43 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 Jun 23 14:07:43 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Delete snapshot completed successfully. Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2a6cf5be-50fe-4ce3-8979-a2c431c589c6 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-b661753d-d772-4940-a2c7-48f11e91a1db-delete_snapshot" released by "delete_snapshot" :: held 4.476s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:43 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04" returned: 0 in 0.944s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.498s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Creating offline snapshot 1ee37dca-bb58-44fc-b7c1-cee91719aa38 of volume 896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-a34c937d-a352-4609-adbd-3929df9d0378-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[120395cc-1c9d-4656-b0f7-791c6dfb21fe]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-361340ea-8d6a-49ba-9078-7b2477f64d04', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53601da7-7452-44ee-93e8-e3c3d89540a6', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-a34c937d-a352-4609-adbd-3929df9d0378-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-a34c937d-a352-4609-adbd-3929df9d0378" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-a34c937d-a352-4609-adbd-3929df9d0378" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Deleting offline snapshot a34c937d-a352-4609-adbd-3929df9d0378 of volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] snapshot_file for this snap is: volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:07:44 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:44 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[47936764-ad2a-426e-b585-de85262b8e0c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-87fe9af1-878b-41cd-96e5-424a54ade72d req-50f6e5fc-2548-44b6-8e8d-e2217610deff tempest-TestInstancesWithCinderVolumes-1629233990 None] attachment_update completed successfully. Jun 23 14:07:44 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:44 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:44 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 1.011s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-896e215d-3e77-443d-983a-1d379e1e1ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:45 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 1G Jun 23 14:07:45 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:45 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 1.016s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:45 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa95169b-e73d-4492-8868-00928a3153ed]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:45 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:45 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:46 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 1G" returned: 0 in 1.182s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:46 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 Jun 23 14:07:46 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:46 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 1.040s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:46 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:46 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Flow 'volume_create_manager' (c0e8b18c-96a5-41f7-b8cd-6df96481615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118072c9-89b7-423c-a024-4267438208a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118072c9-89b7-423c-a024-4267438208a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1326050700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c71b0a7-23c2-4f90-a9e6-f172c183f20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016ffb9393474c6dab0a1c0b2cf63deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:46Z,use_quota=True,user_id='8063ad4001f84cf88413dc5cad85dc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86fad62-90da-4615-830d-73852ebc5fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86fad62-90da-4615-830d-73852ebc5fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6ea300-79ee-41c3-84eb-ef0883f668e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6ea300-79ee-41c3-84eb-ef0883f668e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c71b0a7-23c2-4f90-a9e6-f172c183f20f', 'volume_name': 'volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c977f7a-4453-4e23-addf-38c759652035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c977f7a-4453-4e23-addf-38c759652035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a2c6d6-5bbc-47f0-9e67-a0746235458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:46 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Volume 9c71b0a7-23c2-4f90-a9e6-f172c183f20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f', 'volume_size': 1} Jun 23 14:07:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:47 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38" returned: 0 in 0.838s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:47 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 is being set with open permissions: ugo+rw Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:47 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 Jun 23 14:07:47 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:47 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 1.007s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:47 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378 Jun 23 14:07:47 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:47 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38" returned: 0 in 0.803s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1326050700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c71b0a7-23c2-4f90-a9e6-f172c183f20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016ffb9393474c6dab0a1c0b2cf63deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:46Z,use_quota=True,user_id='8063ad4001f84cf88413dc5cad85dc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Creating volume 9c71b0a7-23c2-4f90-a9e6-f172c183f20f {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:47 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:07:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:47 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f 1073741824 Jun 23 14:07:47 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a55995e7-9229-4b31-8788-e30d076a209c tempest-VolumesDeleteCascade-1563062168 None] Create snapshot completed successfully Jun 23 14:07:48 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.a34c937d-a352-4609-adbd-3929df9d0378" returned: 0 in 0.808s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-a34c937d-a352-4609-adbd-3929df9d0378" released by "_delete_snapshot" :: held 4.032s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" released by "delete_snapshot" :: held 4.081s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Created reservations ['e068a3ba-bf97-42e7-bfbc-dd57789047c5', '20c51b39-2942-4a81-91d7-ea1720c17fdd', 'a8a11f66-c2de-4176-a46b-62379329863f', '0ea47d3f-bb3e-4ffb-820f-8f430fb8872a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Delete snapshot completed successfully. Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9855e9a3-1507-4624-8416-561b3b6af324 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-a34c937d-a352-4609-adbd-3929df9d0378-delete_snapshot" released by "delete_snapshot" :: held 4.279s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-896e215d-3e77-443d-983a-1d379e1e1ba3-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-896e215d-3e77-443d-983a-1d379e1e1ba3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Performing cascade delete. {{(pid=93605) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-1ee37dca-bb58-44fc-b7c1-cee91719aa38-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-1ee37dca-bb58-44fc-b7c1-cee91719aa38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-1ee37dca-bb58-44fc-b7c1-cee91719aa38" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-1ee37dca-bb58-44fc-b7c1-cee91719aa38" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Deleting offline snapshot 1ee37dca-bb58-44fc-b7c1-cee91719aa38 of volume 896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:07:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] snapshot_file for this snap is: volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[264f0abc-5f8a-4bc5-9ac8-5ea3607da051]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:49 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f 1073741824" returned: 0 in 1.164s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:49 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 Jun 23 14:07:49 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:49 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f Jun 23 14:07:49 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-d5a12266-05fb-41e5-b971-5582120dba6a-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-d5a12266-05fb-41e5-b971-5582120dba6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-d5a12266-05fb-41e5-b971-5582120dba6a" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-d5a12266-05fb-41e5-b971-5582120dba6a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Deleting offline snapshot d5a12266-05fb-41e5-b971-5582120dba6a of volume bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] snapshot_file for this snap is: volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9060c527-d52d-4b27-8074-a6bb85aad170]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:49 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:49 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:50 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38" returned: 0 in 1.146s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-896e215d-3e77-443d-983a-1d379e1e1ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:50 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f" returned: 0 in 0.973s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bcbc2b-1666-4b61-a2db-21607ee8466d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a2c6d6-5bbc-47f0-9e67-a0746235458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e418254-3fc0-435f-bfb6-92072841ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:50 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Volume volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f (9c71b0a7-23c2-4f90-a9e6-f172c183f20f): created successfully Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e418254-3fc0-435f-bfb6-92072841ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Flow 'volume_create_manager' (c0e8b18c-96a5-41f7-b8cd-6df96481615f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2931a48a-1e77-4ab7-9841-bfdb6d9d7f2b tempest-VolumeQuotasAdminTestJSON-858036218 None] Created volume successfully. Jun 23 14:07:50 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:50 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:50 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 1.116s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc415dd-72db-4acb-b023-d8861ee26f01]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:50 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 Jun 23 14:07:50 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "cinder-9c71b0a7-23c2-4f90-a9e6-f172c183f20f-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "cinder-9c71b0a7-23c2-4f90-a9e6-f172c183f20f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "cinder-quobyte-9c71b0a7-23c2-4f90-a9e6-f172c183f20f" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "cinder-quobyte-9c71b0a7-23c2-4f90-a9e6-f172c183f20f" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaaac23-5924-4826-a6fc-751a253cc379]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:51 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f Jun 23 14:07:51 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:51 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 1.109s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-896e215d-3e77-443d-983a-1d379e1e1ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:51 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 Jun 23 14:07:51 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:51 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:07:51 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:51 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791" returned: 0 in 1.189s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:51 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:51 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:52 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f" returned: 0 in 1.189s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:52 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f Jun 23 14:07:52 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:52 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38" returned: 0 in 1.293s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:52 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38 Jun 23 14:07:52 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:52 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.270s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:07:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:07:53 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 1.262s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:53 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a Jun 23 14:07:53 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:53 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9c71b0a7-23c2-4f90-a9e6-f172c183f20f" returned: 0 in 1.087s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "cinder-quobyte-9c71b0a7-23c2-4f90-a9e6-f172c183f20f" released by "delete_volume" :: held 2.362s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Created reservations ['e6d0fa44-5f39-42d2-ae3d-9d52be365ea9', '0d76c223-6815-4048-86ab-703e3dc1f48a', '1647c7b1-57a1-4224-8986-ebe8928da336', '709ff472-372d-4304-94dc-72baaffb55ad'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:53 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.1ee37dca-bb58-44fc-b7c1-cee91719aa38" returned: 0 in 1.026s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:53 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:07:53 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-1ee37dca-bb58-44fc-b7c1-cee91719aa38" released by "_delete_snapshot" :: held 4.768s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" released by "delete_snapshot" :: held 4.799s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Created reservations ['2c7e97f5-9723-4b2c-a397-affcaa6be1b7', '7a419e6f-07f9-4b7c-9464-ac2ce3f398c8', 'e54cb07d-ec6d-4901-8536-508dd710a2cd', '22778b8a-4017-4a30-85da-17499ce994d5'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:53 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Delete snapshot completed successfully. Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-1ee37dca-bb58-44fc-b7c1-cee91719aa38-delete_snapshot" released by "delete_snapshot" :: held 5.103s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-fc787f98-0146-4aa9-84a4-99e002fbeac4-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-fc787f98-0146-4aa9-84a4-99e002fbeac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-fc787f98-0146-4aa9-84a4-99e002fbeac4" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-fc787f98-0146-4aa9-84a4-99e002fbeac4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Deleting offline snapshot fc787f98-0146-4aa9-84a4-99e002fbeac4 of volume 896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] snapshot_file for this snap is: volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cae214-0143-42cf-a49e-a990112d39b6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:54 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791.d5a12266-05fb-41e5-b971-5582120dba6a" returned: 0 in 0.983s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-d5a12266-05fb-41e5-b971-5582120dba6a" released by "_delete_snapshot" :: held 4.720s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" released by "delete_snapshot" :: held 4.749s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:54 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:54 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Created reservations ['399a8dda-d4e5-4074-b9b8-e3badf980926', 'f2a78fd4-d1ca-4fac-b03d-de64fd63e1c5', '4eeaf024-eb1e-4e8c-9929-134e106c085c', '5e021c94-db93-46af-a3f9-bdcab1e31919'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Delete snapshot completed successfully. Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c69d316-424a-4c9d-9611-c8165cdc19b1 tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-d5a12266-05fb-41e5-b971-5582120dba6a-delete_snapshot" released by "delete_snapshot" :: held 5.014s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:54 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.955s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Deleted volume successfully. Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c36130fb-7d65-4286-b1b3-46e293d7eec2 tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "cinder-9c71b0a7-23c2-4f90-a9e6-f172c183f20f-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-bd9bb254-06e5-492b-a8d5-80dea8ee6791-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-bd9bb254-06e5-492b-a8d5-80dea8ee6791-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5970d25e-6740-4e9e-b794-2c9fc6ce1c61]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:55 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 1.101s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-896e215d-3e77-443d-983a-1d379e1e1ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f1adab-26fc-4784-ad53-f3d612ff41f6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Flow 'volume_create_manager' (a79e28dd-a1bf-495c-89a6-6429061a10f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f894582-d0d5-4a08-b5fa-91bbce477595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 Jun 23 14:07:55 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f894582-d0d5-4a08-b5fa-91bbce477595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1781319791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649bea9e-7597-47da-9564-dc1205b3fc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016ffb9393474c6dab0a1c0b2cf63deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:55Z,use_quota=True,user_id='8063ad4001f84cf88413dc5cad85dc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d123a3d1-d088-4840-83c6-9e73d398f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d123a3d1-d088-4840-83c6-9e73d398f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a6cd82-5614-4aae-b94a-3f3e38210dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a6cd82-5614-4aae-b94a-3f3e38210dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649bea9e-7597-47da-9564-dc1205b3fc35', 'volume_name': 'volume-649bea9e-7597-47da-9564-dc1205b3fc35', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7b67df-0e9f-46f0-9a43-e1751d395d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7b67df-0e9f-46f0-9a43-e1751d395d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:55 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 Jun 23 14:07:55 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f921da-1269-4eaa-ab39-fed594041ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:55 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Volume 649bea9e-7597-47da-9564-dc1205b3fc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649bea9e-7597-47da-9564-dc1205b3fc35', 'volume_size': 1} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1781319791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649bea9e-7597-47da-9564-dc1205b3fc35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='016ffb9393474c6dab0a1c0b2cf63deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:07:55Z,use_quota=True,user_id='8063ad4001f84cf88413dc5cad85dc75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Creating volume 649bea9e-7597-47da-9564-dc1205b3fc35 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:07:55 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:55 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 1073741824 Jun 23 14:07:55 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:55 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-1dc29603-10d6-42b2-98a8-3b3b43daf3e9 req-c41392ea-c708-415c-b3f8-2fbef5cb30b0 tempest-TestInstancesWithCinderVolumes-1629233990 None] Terminate volume connection completed successfully. Jun 23 14:07:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-1dc29603-10d6-42b2-98a8-3b3b43daf3e9 req-c41392ea-c708-415c-b3f8-2fbef5cb30b0 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deleting attachment 5c5d59d5-370e-4d1f-a7be-68f1a8d39c52. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:07:56 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791" returned: 0 in 1.049s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:56 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791 Jun 23 14:07:56 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:56 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3" returned: 0 in 1.060s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:56 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:56 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:56 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 1073741824" returned: 0 in 1.061s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:56 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 Jun 23 14:07:56 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:57 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bd9bb254-06e5-492b-a8d5-80dea8ee6791" returned: 0 in 0.787s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-quobyte-bd9bb254-06e5-492b-a8d5-80dea8ee6791" released by "delete_volume" :: held 1.973s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Created reservations ['81622c3c-9ea9-45ae-a165-1ff142f90995', 'abb04e2c-f738-4060-b23b-c0a14f98b801', 'aab45f78-82da-4bff-95cc-1457b182061d', '279c6f27-2e42-4e9e-9359-9216f6758630'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:57 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 0.955s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:57 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:07:57 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:57 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4 Jun 23 14:07:57 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:57 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35" returned: 0 in 0.843s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f921da-1269-4eaa-ab39-fed594041ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649bea9e-7597-47da-9564-dc1205b3fc35', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8403c949-a0b8-4fb9-9127-ddb5e3aeab48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:07:57 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Volume volume-649bea9e-7597-47da-9564-dc1205b3fc35 (649bea9e-7597-47da-9564-dc1205b3fc35): created successfully Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8403c949-a0b8-4fb9-9127-ddb5e3aeab48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Flow 'volume_create_manager' (a79e28dd-a1bf-495c-89a6-6429061a10f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "cinder-c08149ff-a574-45cc-9ce9-78ec746e8569-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8ac631a3-0ac4-427a-95e4-1d54db63646c tempest-VolumeQuotasAdminTestJSON-858036218 None] Created volume successfully. Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-c08149ff-a574-45cc-9ce9-78ec746e8569-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "cinder-quobyte-c08149ff-a574-45cc-9ce9-78ec746e8569" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-quobyte-c08149ff-a574-45cc-9ce9-78ec746e8569" acquired by "delete_volume" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0bdcad-6803-4987-8f3f-8e4389b712fc]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:57 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 Jun 23 14:07:57 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:58 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3.fc787f98-0146-4aa9-84a4-99e002fbeac4" returned: 0 in 0.951s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:58 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-fc787f98-0146-4aa9-84a4-99e002fbeac4" released by "_delete_snapshot" :: held 4.224s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.047s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" released by "delete_snapshot" :: held 4.256s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Deleted volume successfully. Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2fa36f58-91a9-44a4-8516-fa2986990f6f tempest-VolumesSnapshotListTestJSON-320262722 None] Lock "cinder-bd9bb254-06e5-492b-a8d5-80dea8ee6791-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Created reservations ['7c3e4e20-9345-4d87-a174-a67ea3493c83', '9bc4ea85-586c-4a0b-b7c0-46a4fc36b8c7', '9a9f974c-c161-48a0-b568-18edf838897c', '83a3c85f-5666-4720-98c6-cd517fc98f9a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:07:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Delete snapshot completed successfully. Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-fc787f98-0146-4aa9-84a4-99e002fbeac4-delete_snapshot" released by "delete_snapshot" :: held 4.630s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Snapshots deleted, issuing volume delete {{(pid=93605) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" acquired by "delete_volume" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[baadfdc1-5964-4838-a31d-adda6f54a40c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:58 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569" returned: 0 in 1.165s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:07:58 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569 Jun 23 14:07:58 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:58 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 Jun 23 14:07:58 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:07:59 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=85,cinder:INSERT=26,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:07:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-51c21852-cf19-4959-8748-4c5aeb0430fd tempest-VolumeQuotasAdminTestJSON-238449758 None] Transfer volume completed successfully. Jun 23 14:07:59 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jun 23 14:07:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3" returned: 0 in 1.154s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:07:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:00 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3 Jun 23 14:08:00 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c08149ff-a574-45cc-9ce9-78ec746e8569" returned: 0 in 1.212s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:00 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-quobyte-c08149ff-a574-45cc-9ce9-78ec746e8569" released by "delete_volume" :: held 2.465s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:00 devstack cinder-volume[93605]: WARNING cinder.quota [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412357500-2064375069 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412357500-2064375069, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:00 devstack cinder-volume[93605]: WARNING cinder.quota [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412357500-2064375069 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-412357500-2064375069, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Created reservations ['58cb5d99-a375-409e-a6e9-06dde256ab8b', 'e7527c55-499d-4745-b582-c41fd70c3216', 'fd2eaa45-7152-4061-9dad-eacc078ef668', 'dbb7142d-893f-4e3a-af3b-b4cf5d7d1d21'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:00 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:00 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:01 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-896e215d-3e77-443d-983a-1d379e1e1ba3" returned: 0 in 1.113s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-896e215d-3e77-443d-983a-1d379e1e1ba3" released by "delete_volume" :: held 2.410s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Acquiring lock "cinder-649bea9e-7597-47da-9564-dc1205b3fc35-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Lock "cinder-649bea9e-7597-47da-9564-dc1205b3fc35-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Created reservations ['b86a1828-d804-46f7-931d-6b6c6906d03f', 'c702d33d-e674-43f5-a29d-f6aa06901b68', '12f88089-2a98-4ebf-a5d2-ba89417bd262', '04f8ea31-dc1d-4d00-86cd-3f49a4bec4ce'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Acquiring lock "cinder-quobyte-649bea9e-7597-47da-9564-dc1205b3fc35" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Lock "cinder-quobyte-649bea9e-7597-47da-9564-dc1205b3fc35" acquired by "delete_volume" :: waited 0.044s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93d5d5-fba5-4d31-bc28-687df5a04ecd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:01 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.114s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:01 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deleted volume successfully. Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4375faca-80ed-4bd5-ad92-aeaf1dec8626 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-c08149ff-a574-45cc-9ce9-78ec746e8569-delete_volume" released by "delete_volume" :: held 3.937s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:01 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:01 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:01 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 Jun 23 14:08:01 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:02 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.975s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:02 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Deleted volume successfully. Jun 23 14:08:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e8e4f990-56da-4a5e-80b0-1b7e7a03464d tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-896e215d-3e77-443d-983a-1d379e1e1ba3-delete_volume" released by "delete_volume" :: held 13.718s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:02 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35" returned: 0 in 1.150s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:02 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35 Jun 23 14:08:02 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:03 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-649bea9e-7597-47da-9564-dc1205b3fc35" returned: 0 in 0.921s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Flow 'volume_create_manager' (1f1b6d07-af4b-4861-aefb-d683bf65da3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d1d570-508e-4f73-8c56-59032fcade09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Lock "cinder-quobyte-649bea9e-7597-47da-9564-dc1205b3fc35" released by "delete_volume" :: held 2.175s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d1d570-508e-4f73-8c56-59032fcade09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-864830820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7f8af3-59b1-4171-b87a-1c663f099a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ec89e755b497484582ba946e59a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:03Z,use_quota=True,user_id='b597213f2aa94118ae3a307e1e545743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadcfde6-ad7a-44c7-9157-ab07d9c52fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eadcfde6-ad7a-44c7-9157-ab07d9c52fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b96702-01e6-4997-b7d7-2777ade0f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b96702-01e6-4997-b7d7-2777ade0f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af7f8af3-59b1-4171-b87a-1c663f099a3a', 'volume_name': 'volume-af7f8af3-59b1-4171-b87a-1c663f099a3a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e37f76-7123-47b2-8744-56b0f54bd599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e37f76-7123-47b2-8744-56b0f54bd599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42915b8c-7bff-454a-80d5-f2e0aa59561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:03 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Volume af7f8af3-59b1-4171-b87a-1c663f099a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af7f8af3-59b1-4171-b87a-1c663f099a3a', 'volume_size': 1} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-864830820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af7f8af3-59b1-4171-b87a-1c663f099a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ec89e755b497484582ba946e59a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:03Z,use_quota=True,user_id='b597213f2aa94118ae3a307e1e545743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Creating volume af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:03 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:03 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a 1073741824 Jun 23 14:08:03 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Created reservations ['fef41f4a-804d-4046-a12d-f6db478c0c6c', 'd25116f1-3348-4297-9d53-3fb821c0e07b', '85255fe0-dbe7-4555-a775-78123badfa64', '24b3b4e9-6146-4d17-80aa-be08b4b41fef'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:03 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:03 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Flow 'volume_create_manager' (8941a0fe-fb41-4389-be61-e4c3c1396703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55ab60-baaa-445a-bdef-b05f9224617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c55ab60-baaa-445a-bdef-b05f9224617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1538749473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d80837-5a40-4d10-af02-5d5ff468f8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702bac47721f4a10883caff2e3562e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:04Z,use_quota=True,user_id='c5f04ffc83a44eb48e023821156ff068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4430070-0578-4cb5-923a-aeea672002a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4430070-0578-4cb5-923a-aeea672002a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a7b5f-354f-45c8-9115-40573174156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a7b5f-354f-45c8-9115-40573174156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d80837-5a40-4d10-af02-5d5ff468f8b3', 'volume_name': 'volume-94d80837-5a40-4d10-af02-5d5ff468f8b3', 'volume_size': 2}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147a653d-1d08-49c6-bf28-1d28a5993073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147a653d-1d08-49c6-bf28-1d28a5993073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa63140-65e2-43b9-a6eb-957e1e0944b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:04 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Volume 94d80837-5a40-4d10-af02-5d5ff468f8b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d80837-5a40-4d10-af02-5d5ff468f8b3', 'volume_size': 2} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-1315cf32-0960-4422-b772-242bdf8bf9d5 req-7cc5f942-119f-4ec7-8d03-894b54a9f5d6 tempest-TestInstancesWithCinderVolumes-1629233990 None] Terminate volume connection completed successfully. Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-1315cf32-0960-4422-b772-242bdf8bf9d5 req-7cc5f942-119f-4ec7-8d03-894b54a9f5d6 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deleting attachment 53601da7-7452-44ee-93e8-e3c3d89540a6. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:08:04 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.887s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Deleted volume successfully. Jun 23 14:08:04 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a 1073741824" returned: 0 in 1.218s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-520f15e5-0737-43da-998e-91408366eae0 tempest-VolumeQuotasAdminTestJSON-1039484677 None] Lock "cinder-649bea9e-7597-47da-9564-dc1205b3fc35-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:04 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:04 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:05 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 0.761s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1538749473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d80837-5a40-4d10-af02-5d5ff468f8b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702bac47721f4a10883caff2e3562e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:04Z,use_quota=True,user_id='c5f04ffc83a44eb48e023821156ff068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Creating volume 94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:05 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 2147483648 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:05 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 2147483648 Jun 23 14:08:05 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42915b8c-7bff-454a-80d5-f2e0aa59561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af7f8af3-59b1-4171-b87a-1c663f099a3a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2fc343-5357-4979-8735-7748e624721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:05 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Volume volume-af7f8af3-59b1-4171-b87a-1c663f099a3a (af7f8af3-59b1-4171-b87a-1c663f099a3a): created successfully Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2fc343-5357-4979-8735-7748e624721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Flow 'volume_create_manager' (1f1b6d07-af4b-4861-aefb-d683bf65da3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d995b63d-8eaf-463e-a4ad-7a3c24fc1767 tempest-VolumesDeleteCascade-1563062168 None] Created volume successfully. Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "cinder-361340ea-8d6a-49ba-9078-7b2477f64d04-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-361340ea-8d6a-49ba-9078-7b2477f64d04-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "cinder-quobyte-361340ea-8d6a-49ba-9078-7b2477f64d04" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-quobyte-361340ea-8d6a-49ba-9078-7b2477f64d04" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf084a1b-3639-4c97-add6-3da4bdbba3d3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:06 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 Jun 23 14:08:06 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:06 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 2147483648" returned: 0 in 1.347s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:07 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 Jun 23 14:08:07 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:07 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04" returned: 0 in 1.288s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:07 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04 Jun 23 14:08:07 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:08 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3" returned: 0 in 1.183s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] <== create_volume: return (2646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.327s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa63140-65e2-43b9-a6eb-957e1e0944b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d80837-5a40-4d10-af02-5d5ff468f8b3', 'volume_size': 2}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e0b77c-3046-44ca-854a-d4fad907725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Creating offline snapshot 049b88d0-62b2-4397-b48f-229adc7fca8b of volume af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:08 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Volume volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 (94d80837-5a40-4d10-af02-5d5ff468f8b3): created successfully Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e0b77c-3046-44ca-854a-d4fad907725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Flow 'volume_create_manager' (8941a0fe-fb41-4389-be61-e4c3c1396703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d69f20-f5cf-46b9-9fa3-31f36ff96716]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-48f09ad8-5ede-47fe-bcda-a273ed56f1f9 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Created volume successfully. Jun 23 14:08:08 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:08 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:08 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-361340ea-8d6a-49ba-9078-7b2477f64d04" returned: 0 in 1.247s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-quobyte-361340ea-8d6a-49ba-9078-7b2477f64d04" released by "delete_volume" :: held 2.612s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:08 devstack cinder-volume[93605]: WARNING cinder.quota [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-52123300-1244632946 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-52123300-1244632946, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:08 devstack cinder-volume[93605]: WARNING cinder.quota [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-52123300-1244632946 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-52123300-1244632946, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:08 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Created reservations ['1cb0499c-4330-4301-83db-689d0f058c55', '959b756f-73ec-4fde-9023-1ec97c4d8e21', 'c0528d58-cc46-4cbb-b485-20f4b27252ee', '8ad0a7f6-59c6-423c-b4b1-a2b7a3b5162a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:09 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:09 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:09 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 1.203s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:09 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b 1G Jun 23 14:08:09 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.035s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:10 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:10 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:10 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Deleted volume successfully. Jun 23 14:08:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-369eeeab-cbaf-4a63-8782-8715ff8db803 tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-361340ea-8d6a-49ba-9078-7b2477f64d04-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:11 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b 1G" returned: 0 in 1.441s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7f8af3-59b1-4171-b87a-1c663f099a3a -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:11 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7f8af3-59b1-4171-b87a-1c663f099a3a -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b Jun 23 14:08:11 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:12 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af7f8af3-59b1-4171-b87a-1c663f099a3a -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b" returned: 0 in 1.120s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:12 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b is being set with open permissions: ugo+rw Jun 23 14:08:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:12 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b Jun 23 14:08:12 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:13 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b" returned: 0 in 1.066s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:13 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info Jun 23 14:08:13 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:14 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info" returned: 0 in 1.023s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:14 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info is being set with open permissions: ugo+rw Jun 23 14:08:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:14 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info Jun 23 14:08:14 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:15 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.info" returned: 0 in 0.795s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.857s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.027s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Creating offline snapshot c3400cea-5ac2-4588-b2c2-76c117fff297 of volume 94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:08:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-fd085a25-44c8-48da-9f93-048276311e78 tempest-VolumesDeleteCascade-1563062168 None] Create snapshot completed successfully Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[025c520f-0810-49e3-8274-609bc6ed7cee]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Flow 'volume_create_manager' (2ddab08d-2ce9-48e5-b95d-a410d40f2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044dc617-600b-4e99-b362-3a3ee000fcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:15 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 Jun 23 14:08:15 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044dc617-600b-4e99-b362-3a3ee000fcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1853364786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8528d415-0b76-4ef5-8ddd-20e997da29dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f761ba3d6b74e4a881bb604c6277a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:15Z,use_quota=True,user_id='76380b8c3fc646f7828caa8c91f21495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94c5bbc-e5a0-42e9-8c3d-2fe6b1ca1734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94c5bbc-e5a0-42e9-8c3d-2fe6b1ca1734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95eb20-8b94-41e4-a924-0b9b115f350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:08:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-73326eaa-f9a5-4768-99b6-a213eabf5320 req-df66a663-3a3d-4988-8d51-275a0023000a tempest-TestInstancesWithCinderVolumes-1629233990 None] Terminate volume connection completed successfully. Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-73326eaa-f9a5-4768-99b6-a213eabf5320 req-df66a663-3a3d-4988-8d51-275a0023000a tempest-TestInstancesWithCinderVolumes-1629233990 None] Deleting attachment 54e061cb-e7d5-4e5a-b3b4-9450bb6e94a9. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95eb20-8b94-41e4-a924-0b9b115f350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8528d415-0b76-4ef5-8ddd-20e997da29dd', 'volume_name': 'volume-8528d415-0b76-4ef5-8ddd-20e997da29dd', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6873a0-850a-4d09-b044-b8d962623ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6873a0-850a-4d09-b044-b8d962623ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375845ab-f620-4b0a-b7d7-939c2b67f4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:15 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Volume 8528d415-0b76-4ef5-8ddd-20e997da29dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8528d415-0b76-4ef5-8ddd-20e997da29dd', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:08:15 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Trying to clone 8528d415-0b76-4ef5-8ddd-20e997da29dd from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:08:16 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3" returned: 0 in 1.057s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 2G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:16 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 2G Jun 23 14:08:16 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:08:16 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Flow 'volume_create_manager' (a5bc634f-aa89-42da-b518-1de964ce2f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d42c4ca-d6d9-4d88-98eb-d38b19da12d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66300e7-1c36-483a-8f70-220e266e92ef]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d42c4ca-d6d9-4d88-98eb-d38b19da12d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1787139151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663f74c2-72d4-409c-a7bb-4664e7d69362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='856ec89e755b497484582ba946e59a4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=049b88d0-62b2-4397-b48f-229adc7fca8b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:16Z,use_quota=True,user_id='b597213f2aa94118ae3a307e1e545743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a75691-9ca6-4216-be4b-93cb21d04505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a75691-9ca6-4216-be4b-93cb21d04505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff23a0f-6ba5-483f-b918-49af5dcdee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff23a0f-6ba5-483f-b918-49af5dcdee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '663f74c2-72d4-409c-a7bb-4664e7d69362', 'volume_name': 'volume-663f74c2-72d4-409c-a7bb-4664e7d69362', 'volume_size': 1, 'snapshot_id': '049b88d0-62b2-4397-b48f-229adc7fca8b'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c5f251-9c0a-40ce-be40-d74030e61c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c5f251-9c0a-40ce-be40-d74030e61c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b89d3-9b22-413c-990a-1d6825638c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Volume 663f74c2-72d4-409c-a7bb-4664e7d69362: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-663f74c2-72d4-409c-a7bb-4664e7d69362', 'volume_size': 1, 'snapshot_id': '049b88d0-62b2-4397-b48f-229adc7fca8b'} Jun 23 14:08:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:16 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD Jun 23 14:08:16 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:17 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 2G" returned: 0 in 1.033s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:17 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 Jun 23 14:08:17 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:17 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:17 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d is fetched for user 76380b8c3fc646f7828caa8c91f21495. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:08:17 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa80147-0747-4e27-8ad0-57f9cba37a6d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:17 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD Jun 23 14:08:17 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:18 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297" returned: 0 in 0.875s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:18 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 is being set with open permissions: ugo+rw Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:18 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 Jun 23 14:08:18 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:18 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:18 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "cinder-45d4e178-00b1-458a-a5b9-b3aaae7d8124-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297" returned: 0 in 0.755s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-45d4e178-00b1-458a-a5b9-b3aaae7d8124-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:19 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info Jun 23 14:08:19 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "cinder-quobyte-45d4e178-00b1-458a-a5b9-b3aaae7d8124" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-quobyte-45d4e178-00b1-458a-a5b9-b3aaae7d8124" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8af862-fc00-4f1f-a2ee-cc16e06674bd]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:19 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:08:19 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:19 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info" returned: 0 in 0.771s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:19 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info is being set with open permissions: ugo+rw Jun 23 14:08:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:19 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info Jun 23 14:08:19 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:20 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 0 in 0.919s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:20 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:08:20 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:20 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.info" returned: 0 in 0.735s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.394s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-049b88d0-62b2-4397-b48f-229adc7fca8b-663f74c2-72d4-409c-a7bb-4664e7d69362" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-049b88d0-62b2-4397-b48f-229adc7fca8b-663f74c2-72d4-409c-a7bb-4664e7d69362" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Creating volume 663f74c2-72d4-409c-a7bb-4664e7d69362 from snapshot 049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-663f74c2-72d4-409c-a7bb-4664e7d69362" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:20 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b62d5468-4306-4050-a76d-5e432fc2458a tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Create snapshot completed successfully Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-663f74c2-72d4-409c-a7bb-4664e7d69362" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] snapshot: 049b88d0-62b2-4397-b48f-229adc7fca8b, volume: 663f74c2-72d4-409c-a7bb-4664e7d69362, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c56939-be2d-40a5-9809-8a80cb790b11]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:20 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b Jun 23 14:08:20 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:20 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 1 in 0.863s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:08:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:20 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124 Jun 23 14:08:20 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:21 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b" returned: 0 in 0.877s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af7f8af3-59b1-4171-b87a-1c663f099a3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a014d82-82e7-4f8a-8dc6-6e9886491a8f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:21 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-45d4e178-00b1-458a-a5b9-b3aaae7d8124" returned: 0 in 0.727s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-quobyte-45d4e178-00b1-458a-a5b9-b3aaae7d8124" released by "delete_volume" :: held 2.601s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:21 devstack cinder-volume[93605]: WARNING cinder.quota [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1210772720-1137769942 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1210772720-1137769942, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:21 devstack cinder-volume[93605]: WARNING cinder.quota [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1210772720-1137769942 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1210772720-1137769942, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:08:21 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:21 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Created reservations ['248b69f8-58c9-4290-b037-c765b04a4b98', '00dfc98f-8b10-4dc9-9d71-d56534171ce9', '773b133f-2932-4505-a21a-f547fd6e84fc', 'e3f78dc4-d1ab-4370-8194-e6f676a009a1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "cinder-c3400cea-5ac2-4588-b2c2-76c117fff297-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:21 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-c3400cea-5ac2-4588-b2c2-76c117fff297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "cinder-quobyte-94d80837-5a40-4d10-af02-5d5ff468f8b3" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:21 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-quobyte-94d80837-5a40-4d10-af02-5d5ff468f8b3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "cinder-quobyte-c3400cea-5ac2-4588-b2c2-76c117fff297" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-quobyte-c3400cea-5ac2-4588-b2c2-76c117fff297" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Deleting offline snapshot c3400cea-5ac2-4588-b2c2-76c117fff297 of volume 94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] snapshot_file for this snap is: volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac93ac08-4776-4854-bf1b-e2d456044277]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:22 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 Jun 23 14:08:22 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:22 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 1.063s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:22 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.866s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:22 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 Jun 23 14:08:22 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:22 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Deleted volume successfully. Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e71dd550-c16e-4cc4-a4ba-844d81dc90db tempest-TestInstancesWithCinderVolumes-1629233990 None] Lock "cinder-45d4e178-00b1-458a-a5b9-b3aaae7d8124-delete_volume" released by "delete_volume" :: held 3.791s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:22 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297" returned: 0 in 0.957s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94d80837-5a40-4d10-af02-5d5ff468f8b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c057535d-cf13-404b-9aee-aa736a3a5348]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:23 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 Jun 23 14:08:23 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:24 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3" returned: 0 in 1.357s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:24 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 Jun 23 14:08:24 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:26 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297" returned: 0 in 2.343s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:26 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297 Jun 23 14:08:26 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:28 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3.c3400cea-5ac2-4588-b2c2-76c117fff297" returned: 0 in 1.811s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-quobyte-c3400cea-5ac2-4588-b2c2-76c117fff297" released by "_delete_snapshot" :: held 6.691s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-quobyte-94d80837-5a40-4d10-af02-5d5ff468f8b3" released by "delete_snapshot" :: held 6.753s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:28 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Created reservations ['85ff19e2-3fe9-4e83-a684-d11e333c994d', 'adc4ba1d-c848-4100-8339-dc4816000f1e', 'a2b4f190-faa0-4b9f-b43d-5e6388e39db1', '84fea21f-f099-42f4-9bff-d393c535b8bd'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:28 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Delete snapshot completed successfully. Jun 23 14:08:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a62a5c23-bf26-4457-adb0-05d5c1bb69ea tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-c3400cea-5ac2-4588-b2c2-76c117fff297-delete_snapshot" released by "delete_snapshot" :: held 7.101s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:29 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362" returned: 0 in 6.367s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1254aa-1b22-4d1e-9ca2-ff402678ce6a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:29 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:29 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "cinder-94d80837-5a40-4d10-af02-5d5ff468f8b3-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-94d80837-5a40-4d10-af02-5d5ff468f8b3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "cinder-quobyte-94d80837-5a40-4d10-af02-5d5ff468f8b3" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-quobyte-94d80837-5a40-4d10-af02-5d5ff468f8b3" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d055c32-9360-4b14-99a3-535c09913905]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:30 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 Jun 23 14:08:30 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:30 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 1.249s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:30 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:08:30 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Converted 1024.00 MB image at 160.76 MB/s Jun 23 14:08:30 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 is being set with open permissions: ugo+rw Jun 23 14:08:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:30 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 Jun 23 14:08:30 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3" returned: 0 in 1.094s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:30 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:31 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3 Jun 23 14:08:31 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:31 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362" returned: 0 in 0.787s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-663f74c2-72d4-409c-a7bb-4664e7d69362" released by "_copy_volume_from_snapshot" :: held 10.480s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-049b88d0-62b2-4397-b48f-229adc7fca8b-663f74c2-72d4-409c-a7bb-4664e7d69362" released by "_create_volume_from_snapshot" :: held 10.529s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.573s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.840s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1853364786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8528d415-0b76-4ef5-8ddd-20e997da29dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f761ba3d6b74e4a881bb604c6277a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:15Z,use_quota=True,user_id='76380b8c3fc646f7828caa8c91f21495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Creating volume 8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:31 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:31 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd 1073741824 Jun 23 14:08:31 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b89d3-9b22-413c-990a-1d6825638c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663f74c2-72d4-409c-a7bb-4664e7d69362', 'volume_size': 1, 'snapshot_id': '049b88d0-62b2-4397-b48f-229adc7fca8b'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65edcf1d-7fd1-41ff-b736-b36e9ac293f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Volume volume-663f74c2-72d4-409c-a7bb-4664e7d69362 (663f74c2-72d4-409c-a7bb-4664e7d69362): created successfully Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65edcf1d-7fd1-41ff-b736-b36e9ac293f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Flow 'volume_create_manager' (a5bc634f-aa89-42da-b518-1de964ce2f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a1e0ae09-e6c7-4d18-b43a-035f28a43592 tempest-VolumesDeleteCascade-1563062168 None] Created volume successfully. Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-af7f8af3-59b1-4171-b87a-1c663f099a3a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-af7f8af3-59b1-4171-b87a-1c663f099a3a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Performing cascade delete. {{(pid=93605) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-049b88d0-62b2-4397-b48f-229adc7fca8b-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-049b88d0-62b2-4397-b48f-229adc7fca8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:31 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-94d80837-5a40-4d10-af02-5d5ff468f8b3" returned: 0 in 0.932s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-af7f8af3-59b1-4171-b87a-1c663f099a3a" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-quobyte-94d80837-5a40-4d10-af02-5d5ff468f8b3" released by "delete_volume" :: held 2.136s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-af7f8af3-59b1-4171-b87a-1c663f099a3a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-049b88d0-62b2-4397-b48f-229adc7fca8b" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-049b88d0-62b2-4397-b48f-229adc7fca8b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Deleting offline snapshot 049b88d0-62b2-4397-b48f-229adc7fca8b of volume af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] snapshot_file for this snap is: volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc215f-c07a-4c58-bdd4-7ea3ba4c21bb]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Created reservations ['097fb00a-701a-4965-bae4-14d99ed24276', '439eec28-39c0-4adc-9201-3fc9f1c73860', 'eee68e1f-8d43-4818-9259-8ec3ee12d9eb', 'd9e1df6d-c097-4e12-8050-fc76485188c9'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:32 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b Jun 23 14:08:32 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:32 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:32 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:32 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd 1073741824" returned: 0 in 1.242s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:32 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:32 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:33 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.040s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Deleted volume successfully. Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=122,cinder:UPDATE=117,cinder:DELETE=11,cinder:INSERT=27 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:08:33 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b" returned: 0 in 1.227s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af7f8af3-59b1-4171-b87a-1c663f099a3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5812b78a-c4ee-4353-b7ae-e0dd3b414d82 tempest-VolumesSnapshotNegativeTestJSON-979661766 None] Lock "cinder-94d80837-5a40-4d10-af02-5d5ff468f8b3-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7334f28a-0cb6-4ee7-be9e-2ecea882be87]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:33 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 0 in 0.947s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Attempting download of c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume 8528d415-0b76-4ef5-8ddd-20e997da29dd. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:08:33 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:33 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a3c083-5c28-4b2c-b8cb-c01bba7ffd55]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:33 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su Jun 23 14:08:33 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:34 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 1.043s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:34 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b Jun 23 14:08:34 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:34 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su" returned: 0 in 1.102s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:34 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su Jun 23 14:08:34 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:35 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b" returned: 0 in 1.229s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:35 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su" returned: 1 in 1.002s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d__8pcz4su' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:08:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[829809ac-efd5-4553-9aa7-3fe87d182788]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:35 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b Jun 23 14:08:35 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:35 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD Jun 23 14:08:35 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:36 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a.049b88d0-62b2-4397-b48f-229adc7fca8b" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-049b88d0-62b2-4397-b48f-229adc7fca8b" released by "_delete_snapshot" :: held 4.734s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-af7f8af3-59b1-4171-b87a-1c663f099a3a" released by "delete_snapshot" :: held 4.775s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Created reservations ['7113ec5a-854e-40c4-903b-595151100fce', 'aafe25c3-247d-487c-ba48-9513c3a6489c', 'cf394577-deb2-479c-b69d-fc31d9e35e7a', 'e3935607-c046-4683-ba91-13ce3330798b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:36 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Delete snapshot completed successfully. Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-049b88d0-62b2-4397-b48f-229adc7fca8b-delete_snapshot" released by "delete_snapshot" :: held 5.066s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Snapshots deleted, issuing volume delete {{(pid=93605) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-af7f8af3-59b1-4171-b87a-1c663f099a3a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-af7f8af3-59b1-4171-b87a-1c663f099a3a" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:37 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD" returned: 0 in 1.423s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df27e6-3427-4025-814b-660ca1710e1c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:37 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d was qcow2, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:08:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:37 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:37 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:37 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:37 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:38 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 1.266s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:38 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a Jun 23 14:08:38 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:39 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-af7f8af3-59b1-4171-b87a-1c663f099a3a" returned: 0 in 0.985s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-af7f8af3-59b1-4171-b87a-1c663f099a3a" released by "delete_volume" :: held 2.419s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Created reservations ['c2da6db6-c3ef-4eb4-90f9-c2599e46475c', 'b23b8253-0165-4fb2-9652-9884644c0404', '183a22b5-093d-473d-a7b5-0198ffcb3208', '57352173-862e-4db8-b279-0a4b8b9ac55a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:39 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:39 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-663f74c2-72d4-409c-a7bb-4664e7d69362-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-663f74c2-72d4-409c-a7bb-4664e7d69362-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "cinder-quobyte-663f74c2-72d4-409c-a7bb-4664e7d69362" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-663f74c2-72d4-409c-a7bb-4664e7d69362" acquired by "delete_volume" :: waited 0.070s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cadd9eb-4596-48b9-b4ac-7af637a1f482]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:40 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:40 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 0 in 3.520s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_rs2l8m4ddevstack@QuobyteHD, size 112.00 MB, duration 3.53 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:08:40 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:40 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Converted 112.00 MB image at 31.77 MB/s Jun 23 14:08:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:40 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd 1G Jun 23 14:08:40 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:41 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.351s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:41 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Deleted volume successfully. Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-18bcca04-e7d0-4520-bf95-16bd199a9614 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-af7f8af3-59b1-4171-b87a-1c663f099a3a-delete_volume" released by "delete_volume" :: held 9.325s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:41 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362" returned: 0 in 1.148s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:41 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362 Jun 23 14:08:41 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:41 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd 1G" returned: 0 in 1.122s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8351d3e9-3dce-45af-ab68-f9b8c7c69a35]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:41 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:41 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:42 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-663f74c2-72d4-409c-a7bb-4664e7d69362" returned: 0 in 0.986s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-quobyte-663f74c2-72d4-409c-a7bb-4664e7d69362" released by "delete_volume" :: held 2.225s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Created reservations ['6f048637-722b-4732-9baa-f89733584377', '19b7de80-426f-493a-96d1-c023f6e96f8e', 'e41d92db-155a-4d20-b621-cf2c5cf8d823', '7779f63c-5110-42c5-9e09-09c2c3b02ca7'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:42 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:42 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:42 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 0 in 1.178s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:43 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:43 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:43 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.056s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:43 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Deleted volume successfully. Jun 23 14:08:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a2b342af-013c-4f32-ab45-68a99f50a727 tempest-VolumesDeleteCascade-1563062168 None] Lock "cinder-663f74c2-72d4-409c-a7bb-4664e7d69362-delete_volume" released by "delete_volume" :: held 3.833s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:44 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 1 in 1.333s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Downloaded image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume 8528d415-0b76-4ef5-8ddd-20e997da29dd successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d for user 76380b8c3fc646f7828caa8c91f21495 is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Marking volume 8528d415-0b76-4ef5-8ddd-20e997da29dd as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Copying metadata from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d to 8528d415-0b76-4ef5-8ddd-20e997da29dd. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Creating volume glance metadata for volume 8528d415-0b76-4ef5-8ddd-20e997da29dd backed by image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375845ab-f620-4b0a-b7d7-939c2b67f4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8528d415-0b76-4ef5-8ddd-20e997da29dd', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c64690-638d-40a4-b6bd-8b22ca8b7125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:44 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Volume volume-8528d415-0b76-4ef5-8ddd-20e997da29dd (8528d415-0b76-4ef5-8ddd-20e997da29dd): created successfully Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c64690-638d-40a4-b6bd-8b22ca8b7125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Flow 'volume_create_manager' (2ddab08d-2ce9-48e5-b95d-a410d40f2c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-10986df6-7a9d-49e8-80b6-70b64e53a941 tempest-VolumesImageMetadata-884347460 None] Created volume successfully. Jun 23 14:08:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Acquiring lock "cinder-8528d415-0b76-4ef5-8ddd-20e997da29dd-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Lock "cinder-8528d415-0b76-4ef5-8ddd-20e997da29dd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Acquiring lock "cinder-quobyte-8528d415-0b76-4ef5-8ddd-20e997da29dd" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Lock "cinder-quobyte-8528d415-0b76-4ef5-8ddd-20e997da29dd" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbddb3f-4eee-41d5-929c-de9640915c3d]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:46 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:46 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:47 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 0 in 1.165s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:47 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:47 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:48 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 1 in 1.228s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:08:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:48 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd Jun 23 14:08:48 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:49 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8528d415-0b76-4ef5-8ddd-20e997da29dd" returned: 0 in 1.041s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Lock "cinder-quobyte-8528d415-0b76-4ef5-8ddd-20e997da29dd" released by "delete_volume" :: held 3.532s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Flow 'volume_create_manager' (f5557534-d3cc-4b8f-a634-61e22363e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e66c89-8dfc-4442-b277-719ff8dbcb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e66c89-8dfc-4442-b277-719ff8dbcb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1275439482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7813f76-056a-425e-b70f-eda71b071a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23618cc0c5469e8d323ab8c814318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:50Z,use_quota=True,user_id='3fbdc99a08974608b40ae64c2b6e3a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0140ac-25e1-4ffa-a9f9-f6cddd7de940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0140ac-25e1-4ffa-a9f9-f6cddd7de940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc8967c-e91c-4796-9bd3-13a24d499e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc8967c-e91c-4796-9bd3-13a24d499e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7813f76-056a-425e-b70f-eda71b071a6a', 'volume_name': 'volume-e7813f76-056a-425e-b70f-eda71b071a6a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3484a154-1d55-43bd-8f99-d0c31e12cb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3484a154-1d55-43bd-8f99-d0c31e12cb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b3615e-3138-4b41-b9b6-ae9211e417c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:49 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Volume e7813f76-056a-425e-b70f-eda71b071a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7813f76-056a-425e-b70f-eda71b071a6a', 'volume_size': 1} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1275439482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7813f76-056a-425e-b70f-eda71b071a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f23618cc0c5469e8d323ab8c814318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:50Z,use_quota=True,user_id='3fbdc99a08974608b40ae64c2b6e3a90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Creating volume e7813f76-056a-425e-b70f-eda71b071a6a {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:49 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:49 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a 1073741824 Jun 23 14:08:49 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:49 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Created reservations ['b2d52b38-e2a7-4c51-8b83-5bde2646f038', '71d201b5-936d-48f2-9e47-a868ffcffc4e', 'e7f40992-4778-40fc-83d6-0c8486dc5e29', '93a3487e-d062-4efc-93aa-8ce6cce5c3c7'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:50 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:50 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:51 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.110s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Deleted volume successfully. Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-aa88bf96-0759-4c3e-8e32-e04293c1b459 tempest-VolumesImageMetadata-884347460 None] Lock "cinder-8528d415-0b76-4ef5-8ddd-20e997da29dd-delete_volume" released by "delete_volume" :: held 5.195s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:51 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a 1073741824" returned: 0 in 1.474s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:51 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a Jun 23 14:08:51 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:51 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:51 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:52 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a" returned: 0 in 0.770s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b3615e-3138-4b41-b9b6-ae9211e417c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7813f76-056a-425e-b70f-eda71b071a6a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555fc4a8-d52c-429b-8665-7f16f3deceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:52 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Volume volume-e7813f76-056a-425e-b70f-eda71b071a6a (e7813f76-056a-425e-b70f-eda71b071a6a): created successfully Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555fc4a8-d52c-429b-8665-7f16f3deceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Flow 'volume_create_manager' (f5557534-d3cc-4b8f-a634-61e22363e55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-99f7b165-6c0c-483a-bb07-51d19062eaa6 tempest-VolumesMetadataTest-1322654232 None] Created volume successfully. Jun 23 14:08:52 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.923s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:08:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:08:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Acquiring lock "cinder-e7813f76-056a-425e-b70f-eda71b071a6a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Lock "cinder-e7813f76-056a-425e-b70f-eda71b071a6a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Acquiring lock "cinder-quobyte-e7813f76-056a-425e-b70f-eda71b071a6a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:08:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Lock "cinder-quobyte-e7813f76-056a-425e-b70f-eda71b071a6a" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:08:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626c2c0-4c54-4975-a1a4-2a38272d62a5]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:08:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:54 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a Jun 23 14:08:54 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:55 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a" returned: 0 in 1.451s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:55 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a Jun 23 14:08:55 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:56 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e7813f76-056a-425e-b70f-eda71b071a6a" returned: 0 in 1.091s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Lock "cinder-quobyte-e7813f76-056a-425e-b70f-eda71b071a6a" released by "delete_volume" :: held 2.678s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Created reservations ['06600310-6e8c-4a5d-bbf3-873031459738', 'f9afef9e-81dc-487b-97df-1cdd80d7571d', 'ce245f29-080b-4f8b-801b-1853917ffa0e', 'e760aec3-b8b5-4fae-bed0-c8ec6ed85a42'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:57 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:08:57 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Flow 'volume_create_manager' (5ec531c8-d3d2-4b14-a885-1d5ba9d4be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123102ab-34f2-43b2-ba92-3ef00d116dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123102ab-34f2-43b2-ba92-3ef00d116dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1942316703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51b14b1-ec20-4c7b-83b8-4abcfa3222d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60437550bb24f2f93177e2ba198c37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:58Z,use_quota=True,user_id='c2bc4acdf665485d897335dac1e3a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593a1c0f-d510-4c94-b18c-01d99d99529c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593a1c0f-d510-4c94-b18c-01d99d99529c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0add1c5-7245-4d74-a1ac-60fa283af6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0add1c5-7245-4d74-a1ac-60fa283af6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51b14b1-ec20-4c7b-83b8-4abcfa3222d7', 'volume_name': 'volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51312770-1c03-4555-b342-457e92c52fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51312770-1c03-4555-b342-457e92c52fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9416686-9565-4d24-a8e8-bd93ed57b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:08:57 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Volume f51b14b1-ec20-4c7b-83b8-4abcfa3222d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7', 'volume_size': 1} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1942316703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51b14b1-ec20-4c7b-83b8-4abcfa3222d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60437550bb24f2f93177e2ba198c37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:08:58Z,use_quota=True,user_id='c2bc4acdf665485d897335dac1e3a3cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Creating volume f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:08:57 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:08:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:58 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 1073741824 Jun 23 14:08:58 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:08:58 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.288s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:58 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:08:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Deleted volume successfully. Jun 23 14:08:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-6c5b493f-a2ea-4bcb-b2da-5b7eed9e59d5 tempest-VolumesMetadataTest-1322654232 None] Lock "cinder-e7813f76-056a-425e-b70f-eda71b071a6a-delete_volume" released by "delete_volume" :: held 4.439s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:08:59 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Jun 23 14:08:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 1073741824" returned: 0 in 1.313s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:08:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:08:59 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 Jun 23 14:08:59 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:00 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" returned: 0 in 0.925s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] <== create_volume: return (2299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9416686-9565-4d24-a8e8-bd93ed57b002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4178203-c1c8-46c1-9639-b6b7cc939773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=78,cinder:INSERT=38,cinder:UPDATE=117,cinder:DELETE=6 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:09:00 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Volume volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 (f51b14b1-ec20-4c7b-83b8-4abcfa3222d7): created successfully Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4178203-c1c8-46c1-9639-b6b7cc939773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:00 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Flow 'volume_create_manager' (5ec531c8-d3d2-4b14-a885-1d5ba9d4be1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:00 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-689a867c-766e-43c9-b2de-37dd01560f60 tempest-SnapshotMetadataTestJSON-592115913 None] Created volume successfully. Jun 23 14:09:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Creating offline snapshot b4db7e9c-8950-4c36-85ae-7e7a252d1c55 of volume f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:09:01 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684fbe3-70ef-4add-addf-7fbd385c5ba3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:01 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 Jun 23 14:09:01 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:02 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" returned: 0 in 1.140s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:02 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 1G Jun 23 14:09:02 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:03 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 1G" returned: 0 in 1.368s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:03 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 Jun 23 14:09:03 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:05 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55" returned: 0 in 1.321s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:05 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 is being set with open permissions: ugo+rw Jun 23 14:09:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:05 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 Jun 23 14:09:05 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:06 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55" returned: 0 in 1.038s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:06 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info Jun 23 14:09:06 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:07 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info" returned: 0 in 1.164s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:07 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info is being set with open permissions: ugo+rw Jun 23 14:09:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:07 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info Jun 23 14:09:07 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:08 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.info" returned: 0 in 1.053s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.224s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b888091d-5d79-45d6-b193-36df118d88bb tempest-SnapshotMetadataTestJSON-592115913 None] Create snapshot completed successfully Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Flow 'volume_create_manager' (8f521e4f-0b79-4260-897b-6539154d7702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5845ef7-9ac3-446f-88fb-198610895421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5845ef7-9ac3-446f-88fb-198610895421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-815223667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a774b27a-5b3d-4d48-bcc4-8bba2c76a05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e81f164f44e1089ccc624b86ce49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:10Z,use_quota=True,user_id='935ff03b1e734906b14a8fe1a42af7ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9b47c8-a892-4b24-b80a-c100ddcdb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9b47c8-a892-4b24-b80a-c100ddcdb634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b28f6b-0846-48a6-ba7a-525b8aecfe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b28f6b-0846-48a6-ba7a-525b8aecfe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a774b27a-5b3d-4d48-bcc4-8bba2c76a05d', 'volume_name': 'volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20aece50-5c3c-4cdb-b09e-205c2053eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20aece50-5c3c-4cdb-b09e-205c2053eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb4217b-fb47-45de-8ea7-574f4b723132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:09 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Volume a774b27a-5b3d-4d48-bcc4-8bba2c76a05d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d', 'volume_size': 1} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-815223667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a774b27a-5b3d-4d48-bcc4-8bba2c76a05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e81f164f44e1089ccc624b86ce49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:10Z,use_quota=True,user_id='935ff03b1e734906b14a8fe1a42af7ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Creating volume a774b27a-5b3d-4d48-bcc4-8bba2c76a05d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:09 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "cinder-b4db7e9c-8950-4c36-85ae-7e7a252d1c55-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:09 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d 1073741824 Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-b4db7e9c-8950-4c36-85ae-7e7a252d1c55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:09 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "cinder-quobyte-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-quobyte-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "cinder-quobyte-b4db7e9c-8950-4c36-85ae-7e7a252d1c55" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-quobyte-b4db7e9c-8950-4c36-85ae-7e7a252d1c55" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Deleting offline snapshot b4db7e9c-8950-4c36-85ae-7e7a252d1c55 of volume f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:09:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] snapshot_file for this snap is: volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:09:10 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c954837-e8a6-4aae-9f2d-3f99b6e81074]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:10 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 Jun 23 14:09:10 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:11 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d 1073741824" returned: 0 in 1.428s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:11 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55" returned: 0 in 1.308s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:09:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[54da72a8-15f4-4609-bfd4-f056579ad912]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:11 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d Jun 23 14:09:11 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:11 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 Jun 23 14:09:11 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:12 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d" returned: 0 in 1.163s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] <== create_volume: return (2685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.690s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb4217b-fb47-45de-8ea7-574f4b723132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc2a61b-2869-4eb6-8e9f-18e356b78d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:12 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Volume volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d (a774b27a-5b3d-4d48-bcc4-8bba2c76a05d): created successfully Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc2a61b-2869-4eb6-8e9f-18e356b78d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Flow 'volume_create_manager' (8f521e4f-0b79-4260-897b-6539154d7702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-424312ec-6eaf-4cb5-8e79-d79a617d7652 tempest-VolumesTransfersV355Test-277492763 None] Created volume successfully. Jun 23 14:09:12 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" returned: 0 in 1.416s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:12 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 Jun 23 14:09:12 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:14 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55" returned: 0 in 1.363s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:14 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55 Jun 23 14:09:14 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-901ed397-1ee8-4a83-b8a1-a1bf802cd21a tempest-VolumesTransfersV355Test-871702178 None] Transfer volume completed successfully. Jun 23 14:09:15 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7.b4db7e9c-8950-4c36-85ae-7e7a252d1c55" returned: 0 in 0.964s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-quobyte-b4db7e9c-8950-4c36-85ae-7e7a252d1c55" released by "_delete_snapshot" :: held 5.268s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-quobyte-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" released by "delete_snapshot" :: held 5.322s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Created reservations ['b692c71c-2977-4cac-9510-90850a827cb8', 'bda4162f-b2d0-4c4a-963e-808e7524dbda', 'c0340bf8-4699-4828-93f0-7b920d1a7f09', 'fa686efa-692d-4fd3-be16-b1650b43cead'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Delete snapshot completed successfully. Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Acquiring lock "cinder-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65c1d369-f157-478b-9138-2152792a0e9c tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-b4db7e9c-8950-4c36-85ae-7e7a252d1c55-delete_snapshot" released by "delete_snapshot" :: held 5.563s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Acquiring lock "cinder-quobyte-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-quobyte-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6c69a5-2683-4e5d-af6c-99b8c3ab7209]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:15 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d Jun 23 14:09:15 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "cinder-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "cinder-quobyte-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-quobyte-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4de628-74cd-49a7-9c5d-1dd39f0aaf0f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:16 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d" returned: 0 in 1.173s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:16 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d Jun 23 14:09:16 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:16 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 Jun 23 14:09:16 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:18 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d" returned: 0 in 1.146s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-quobyte-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d" released by "delete_volume" :: held 2.394s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:18 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" returned: 0 in 1.335s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:18 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7 Jun 23 14:09:18 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Created reservations ['cfc6e5f7-31ae-479f-b967-42f4ee696239', 'f5ec9c26-320b-4486-a97f-33dde1288758', '743d0454-a305-45d9-83c1-2d51162d2b80', '9fe7244c-c94c-47d5-8800-95a7ef619918'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:18 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:09:18 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:19 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" returned: 0 in 1.335s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-quobyte-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7" released by "delete_volume" :: held 2.832s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Created reservations ['af3269ec-de2f-4fa4-9bc6-2cf1aad2bb28', '0ff4f356-a583-4fe5-9701-2f720d586fa4', '4e5e96cc-6aac-4081-afd9-e8e41647ef0b', 'cdbb0de6-6602-4502-85f2-3430780f176c'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:19 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.376s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Deleted volume successfully. Jun 23 14:09:19 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:09:19 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95d63254-1b85-422b-83b9-e08b5c0af74a tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-a774b27a-5b3d-4d48-bcc4-8bba2c76a05d-delete_volume" released by "delete_volume" :: held 4.235s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Flow 'volume_create_manager' (592605c0-925c-4f20-b6db-217355c1227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05157229-af8b-4fa7-a732-af858cfe3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05157229-af8b-4fa7-a732-af858cfe3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1779272164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e526636-b827-4b3b-a302-6c27b911cab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e81f164f44e1089ccc624b86ce49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:20Z,use_quota=True,user_id='935ff03b1e734906b14a8fe1a42af7ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243ed81-5dec-478a-9e1b-d76919106b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243ed81-5dec-478a-9e1b-d76919106b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab16cc6-a0ad-4dae-85a6-26747a4d777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab16cc6-a0ad-4dae-85a6-26747a4d777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e526636-b827-4b3b-a302-6c27b911cab1', 'volume_name': 'volume-5e526636-b827-4b3b-a302-6c27b911cab1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9582505a-8b34-4ce6-aaef-6c222bb31464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9582505a-8b34-4ce6-aaef-6c222bb31464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc99622c-4677-4085-8064-669460242388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:20 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Volume 5e526636-b827-4b3b-a302-6c27b911cab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e526636-b827-4b3b-a302-6c27b911cab1', 'volume_size': 1} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1779272164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e526636-b827-4b3b-a302-6c27b911cab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8e81f164f44e1089ccc624b86ce49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:20Z,use_quota=True,user_id='935ff03b1e734906b14a8fe1a42af7ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Creating volume 5e526636-b827-4b3b-a302-6c27b911cab1 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:20 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:20 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 1073741824 Jun 23 14:09:20 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:20 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.241s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:20 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Deleted volume successfully. Jun 23 14:09:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f3b0cfd0-08fc-46af-913c-d5b08116b28f tempest-SnapshotMetadataTestJSON-592115913 None] Lock "cinder-f51b14b1-ec20-4c7b-83b8-4abcfa3222d7-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 1073741824" returned: 0 in 1.717s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:22 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:22 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 Jun 23 14:09:22 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:23 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1" returned: 0 in 1.110s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] <== create_volume: return (2907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.912s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc99622c-4677-4085-8064-669460242388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e526636-b827-4b3b-a302-6c27b911cab1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba93049-f80a-4ed3-8e76-21718e5aa275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:23 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Volume volume-5e526636-b827-4b3b-a302-6c27b911cab1 (5e526636-b827-4b3b-a302-6c27b911cab1): created successfully Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ba93049-f80a-4ed3-8e76-21718e5aa275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Flow 'volume_create_manager' (592605c0-925c-4f20-b6db-217355c1227c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:23 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c59d1843-f77f-4b68-94d5-83337a8e94a8 tempest-VolumesTransfersV355Test-277492763 None] Created volume successfully. Jun 23 14:09:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Acquiring lock "cinder-5e526636-b827-4b3b-a302-6c27b911cab1-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-5e526636-b827-4b3b-a302-6c27b911cab1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Acquiring lock "cinder-quobyte-5e526636-b827-4b3b-a302-6c27b911cab1" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-quobyte-5e526636-b827-4b3b-a302-6c27b911cab1" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:25 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af6a20-ce8a-4944-b77b-ffa0bad7efb8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:25 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 Jun 23 14:09:25 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:26 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1" returned: 0 in 1.233s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:26 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1 Jun 23 14:09:26 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:27 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5e526636-b827-4b3b-a302-6c27b911cab1" returned: 0 in 1.083s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-quobyte-5e526636-b827-4b3b-a302-6c27b911cab1" released by "delete_volume" :: held 2.391s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Created reservations ['a98e9308-89f5-4c66-afc2-ab2ee1d0405a', '65eaa721-cc1f-4d01-bb4e-d0ef1602ee15', 'ab6744d5-7ac7-48d0-8616-bc67945a9487', 'f7c8285a-8768-4c4b-9785-79fafa2c4bcd'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:28 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:09:28 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:28 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.000s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:28 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Deleted volume successfully. Jun 23 14:09:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8418b5aa-da0b-4e73-951e-fd4b8aa2e97b tempest-VolumesTransfersV355Test-453291865 None] Lock "cinder-5e526636-b827-4b3b-a302-6c27b911cab1-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Flow 'volume_create_manager' (1aa9cb62-ffa2-4e71-8c90-1c188cb281d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea643ba4-b9b9-4622-b1b9-fc14a82ce4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea643ba4-b9b9-4622-b1b9-fc14a82ce4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-538231120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267960d6-a9b2-42c0-b18b-2b668f7d7c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0652023a6ead44a69c2dd496c427811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:31Z,use_quota=True,user_id='52aa3558e3a3430e85305e74eeb27165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d4ae5-8faf-4679-9f75-91fd6b6e6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2d4ae5-8faf-4679-9f75-91fd6b6e6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd55719c-31b8-4a2d-99d2-55101549c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd55719c-31b8-4a2d-99d2-55101549c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '267960d6-a9b2-42c0-b18b-2b668f7d7c4f', 'volume_name': 'volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8e8329-40e7-4cb0-af03-509791b156a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8e8329-40e7-4cb0-af03-509791b156a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2649135e-6ca2-4314-999d-5c04fa68e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Volume 267960d6-a9b2-42c0-b18b-2b668f7d7c4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:09:31 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Trying to clone 267960d6-a9b2-42c0-b18b-2b668f7d7c4f from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:09:32 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:09:32 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:09:32 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ba971e-d6ac-4db4-ab2e-156b8e3d9938]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:32 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD Jun 23 14:09:32 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:33 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD" returned: 0 in 1.423s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:33 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d is fetched for user 52aa3558e3a3430e85305e74eeb27165. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:09:33 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=76,cinder:SELECT=68,cinder:INSERT=24,cinder:DELETE=7 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:09:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fad162-fe67-4a38-b441-d2de8a3c20da]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:34 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD Jun 23 14:09:34 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:34 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD" returned: 0 in 1.063s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-538231120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267960d6-a9b2-42c0-b18b-2b668f7d7c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0652023a6ead44a69c2dd496c427811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:31Z,use_quota=True,user_id='52aa3558e3a3430e85305e74eeb27165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Creating volume 267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:34 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:09:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:34 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 1073741824 Jun 23 14:09:34 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:36 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 1073741824" returned: 0 in 1.578s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:36 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:09:36 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:37 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 0 in 1.183s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] <== create_volume: return (2888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.896s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:37 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Attempting download of c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume 267960d6-a9b2-42c0-b18b-2b668f7d7c4f. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:09:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6925a228-d350-49b9-9a9c-699c264bd01e]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:38 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g Jun 23 14:09:38 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:39 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g" returned: 0 in 1.419s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:39 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g Jun 23 14:09:39 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:40 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g" returned: 1 in 1.033s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_xb_wam9g' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c73dc-1281-4881-ab41-0330e1d9fb3d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:40 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD Jun 23 14:09:40 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:41 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD" returned: 0 in 1.054s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:41 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d was qcow2, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:09:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:41 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:09:41 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Flow 'volume_create_manager' (e9b57f6f-2c21-48e9-bb59-eabd10a67bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cc3ef5-facb-4dcf-9523-138179ad9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cc3ef5-facb-4dcf-9523-138179ad9af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-686122202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69986f2-80ea-4907-b570-799f5f738d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab092269376451cafb95aaaf30fdefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:44Z,use_quota=True,user_id='e3fc38adcbdd49b4a2375c88c896b1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7656f07-f363-4462-a693-23be3ee1526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7656f07-f363-4462-a693-23be3ee1526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96430915-944d-4d10-a19d-77b3f4ba07cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96430915-944d-4d10-a19d-77b3f4ba07cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69986f2-80ea-4907-b570-799f5f738d47', 'volume_name': 'volume-f69986f2-80ea-4907-b570-799f5f738d47', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67194703-7af3-4ad8-8232-406260cf84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67194703-7af3-4ad8-8232-406260cf84be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d70a39-ff9a-477c-9cff-7e54b7b703b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Volume f69986f2-80ea-4907-b570-799f5f738d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69986f2-80ea-4907-b570-799f5f738d47', 'volume_size': 1} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-686122202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69986f2-80ea-4907-b570-799f5f738d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab092269376451cafb95aaaf30fdefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:44Z,use_quota=True,user_id='e3fc38adcbdd49b4a2375c88c896b1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Creating volume f69986f2-80ea-4907-b570-799f5f738d47 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:43 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:09:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:44 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 1073741824 Jun 23 14:09:44 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:45 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 0 in 3.686s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:45 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_aifc6ttxdevstack@QuobyteHD, size 112.00 MB, duration 3.69 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:09:45 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Converted 112.00 MB image at 30.37 MB/s Jun 23 14:09:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:45 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 1G Jun 23 14:09:45 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:46 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 1073741824" returned: 0 in 2.119s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:46 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 Jun 23 14:09:46 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:47 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 1G" returned: 0 in 1.963s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025749e-a1b4-434b-ac8a-f5e77943c840]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:47 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:09:47 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:47 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47" returned: 0 in 1.482s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] <== create_volume: return (3718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.724s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d70a39-ff9a-477c-9cff-7e54b7b703b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69986f2-80ea-4907-b570-799f5f738d47', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f122216b-a023-4bf1-82f7-caaa51d3a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:47 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Volume volume-f69986f2-80ea-4907-b570-799f5f738d47 (f69986f2-80ea-4907-b570-799f5f738d47): created successfully Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f122216b-a023-4bf1-82f7-caaa51d3a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Flow 'volume_create_manager' (e9b57f6f-2c21-48e9-bb59-eabd10a67bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e9237562-052e-467c-add2-616f9296a4f8 tempest-VolumesTransfersV357Test-601144177 None] Created volume successfully. Jun 23 14:09:49 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 0 in 1.987s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:49 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:09:49 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8d4ee876-2d3a-43cb-a3d6-d03784debcdc tempest-VolumesTransfersV357Test-1536219478 None] Transfer volume completed successfully. Jun 23 14:09:51 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 1 in 1.994s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Downloaded image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume 267960d6-a9b2-42c0-b18b-2b668f7d7c4f successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d for user 52aa3558e3a3430e85305e74eeb27165 is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Marking volume 267960d6-a9b2-42c0-b18b-2b668f7d7c4f as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Copying metadata from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d to 267960d6-a9b2-42c0-b18b-2b668f7d7c4f. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Creating volume glance metadata for volume 267960d6-a9b2-42c0-b18b-2b668f7d7c4f backed by image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:51 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:09:51 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2649135e-6ca2-4314-999d-5c04fa68e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ae2991-18d6-4119-8df0-60af450d471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:51 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Volume volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f (267960d6-a9b2-42c0-b18b-2b668f7d7c4f): created successfully Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ae2991-18d6-4119-8df0-60af450d471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:51 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Flow 'volume_create_manager' (1aa9cb62-ffa2-4e71-8c90-1c188cb281d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a34242bb-c84e-4b70-a5e1-00f49a03638b tempest-VolumesExtendTest-575386631 None] Created volume successfully. Jun 23 14:09:52 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Flow 'volume_create_manager' (8deb117f-daf7-4eac-8fc4-4d555387af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3a62cf-d3a8-4627-9df6-048ffec025d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Acquiring lock "cinder-f69986f2-80ea-4907-b570-799f5f738d47-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3a62cf-d3a8-4627-9df6-048ffec025d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1207452374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dccc34b-8bf6-49ad-807b-319f92928799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55746d93447b4405b470accbca855b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:53Z,use_quota=True,user_id='823ede69f53249c8b7f4d016c09eb23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63833b14-782a-412a-8cdd-dc4c706f8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63833b14-782a-412a-8cdd-dc4c706f8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f95b9c-8591-4621-9916-33d36dfa19c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f95b9c-8591-4621-9916-33d36dfa19c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dccc34b-8bf6-49ad-807b-319f92928799', 'volume_name': 'volume-6dccc34b-8bf6-49ad-807b-319f92928799', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d23abed-ad3a-49be-b575-fd941cae22a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d23abed-ad3a-49be-b575-fd941cae22a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b718cebc-05b9-4ff2-bcb7-5f26adc26cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:53 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Volume 6dccc34b-8bf6-49ad-807b-319f92928799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dccc34b-8bf6-49ad-807b-319f92928799', 'volume_size': 1} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1207452374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dccc34b-8bf6-49ad-807b-319f92928799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55746d93447b4405b470accbca855b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:53Z,use_quota=True,user_id='823ede69f53249c8b7f4d016c09eb23b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Creating volume 6dccc34b-8bf6-49ad-807b-319f92928799 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:53 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-f69986f2-80ea-4907-b570-799f5f738d47-delete_volume" acquired by "delete_volume" :: waited 0.281s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:53 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 1073741824 Jun 23 14:09:53 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Acquiring lock "cinder-quobyte-f69986f2-80ea-4907-b570-799f5f738d47" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-quobyte-f69986f2-80ea-4907-b570-799f5f738d47" acquired by "delete_volume" :: waited 0.046s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[20235b2d-bed0-42f3-9305-796ae767af2f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:53 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.946s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:09:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:53 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 Jun 23 14:09:53 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:54 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 1073741824" returned: 0 in 1.701s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:54 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 Jun 23 14:09:54 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:55 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47" returned: 0 in 1.831s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:55 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47 Jun 23 14:09:55 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:55 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799" returned: 0 in 0.956s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] <== create_volume: return (2781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.786s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.068s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b718cebc-05b9-4ff2-bcb7-5f26adc26cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dccc34b-8bf6-49ad-807b-319f92928799', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80653eee-16c2-45c4-8e64-daba3a67b22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddafaab-3165-4b42-8c05-445ac56f3c87]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:09:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:55 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Volume volume-6dccc34b-8bf6-49ad-807b-319f92928799 (6dccc34b-8bf6-49ad-807b-319f92928799): created successfully Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80653eee-16c2-45c4-8e64-daba3a67b22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Flow 'volume_create_manager' (8deb117f-daf7-4eac-8fc4-4d555387af5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:56 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:09:56 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:56 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-227e8431-ee21-4af6-9224-25dfa07aa722 tempest-TestMinimumBasicScenario-327596405 None] Created volume successfully. Jun 23 14:09:56 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f69986f2-80ea-4907-b570-799f5f738d47" returned: 0 in 1.332s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-quobyte-f69986f2-80ea-4907-b570-799f5f738d47" released by "delete_volume" :: held 3.278s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Created reservations ['7ed8c407-5498-43e5-ac16-4186e930adb6', 'f50ccd39-94ad-439b-a0b1-3bfbeb643907', '8656a6b0-8c8a-4e0c-bdff-ed9330ee7ab3', 'd2db9915-931d-492d-8d3c-2874f25bba92'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:56 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:09:56 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:57 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 0 in 1.859s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:58 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:09:58 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:58 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.514s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:09:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Deleted volume successfully. Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-723adfd3-82d0-4584-9b3b-fd0fb710265b tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-f69986f2-80ea-4907-b570-799f5f738d47-delete_volume" released by "delete_volume" :: held 5.358s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Flow 'volume_create_manager' (5a010418-60b8-4978-84a1-64ed6ffaa4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35580cf6-ce51-4890-a156-23055c7ffa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35580cf6-ce51-4890-a156-23055c7ffa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1125116559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd8906d-735a-49cc-bb3c-44a0090bb8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab092269376451cafb95aaaf30fdefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:59Z,use_quota=True,user_id='e3fc38adcbdd49b4a2375c88c896b1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a26b2af-bf21-40e4-8ebb-d4789e5c80ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a26b2af-bf21-40e4-8ebb-d4789e5c80ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9236538-4860-42f3-8575-cf14f574d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9236538-4860-42f3-8575-cf14f574d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd8906d-735a-49cc-bb3c-44a0090bb8f1', 'volume_name': 'volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b90f964-7fc3-4323-8e33-6b555598ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b90f964-7fc3-4323-8e33-6b555598ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb39c06-94da-41c4-a193-2b69bd1ccb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:09:59 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Volume afd8906d-735a-49cc-bb3c-44a0090bb8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1', 'volume_size': 1} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:59 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 1 in 1.489s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 2G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f 2G" returned: 0 in 0.095s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.541s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1125116559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd8906d-735a-49cc-bb3c-44a0090bb8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab092269376451cafb95aaaf30fdefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:09:59Z,use_quota=True,user_id='e3fc38adcbdd49b4a2375c88c896b1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Creating volume afd8906d-735a-49cc-bb3c-44a0090bb8f1 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:09:59 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:09:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:09:59 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 1073741824 Jun 23 14:09:59 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:09:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2315aea5-6b3a-4f6f-8941-50628531ee54 tempest-VolumesExtendTest-575386631 None] Extend volume completed successfully. Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-267960d6-a9b2-42c0-b18b-2b668f7d7c4f-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Lock "cinder-267960d6-a9b2-42c0-b18b-2b668f7d7c4f-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-quobyte-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb49d663-5232-473d-982e-a928ea990f93]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=54,cinder:UPDATE=64,cinder:INSERT=21,cinder:DELETE=6 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:10:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:00 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:10:00 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:01 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 1073741824" returned: 0 in 1.755s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:01 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 Jun 23 14:10:01 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:01 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 0 in 1.420s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:02 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:10:02 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:02 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1" returned: 0 in 1.155s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] <== create_volume: return (2983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.791s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[60800ef6-18b9-4bba-af2a-32ca54c3a2d2]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb39c06-94da-41c4-a193-2b69bd1ccb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfd8325-7aea-4e10-8fcc-a18d589c37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:02 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Volume volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 (afd8906d-735a-49cc-bb3c-44a0090bb8f1): created successfully Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfd8325-7aea-4e10-8fcc-a18d589c37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:02 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Flow 'volume_create_manager' (5a010418-60b8-4978-84a1-64ed6ffaa4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-22710417-0219-45ad-b512-c77c4877f163 tempest-VolumesTransfersV357Test-601144177 None] Created volume successfully. Jun 23 14:10:02 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 Jun 23 14:10:02 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:03 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 1 in 1.278s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:03 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f Jun 23 14:10:03 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:03 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799" returned: 0 in 1.011s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.040s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-6dccc34b-8bf6-49ad-807b-319f92928799', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea13d27c-f004-4f3b-aca6-f05371c38ff6', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:10:03 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-85f66cc1-d330-474b-a67a-cff77c7f9068 req-c83236cd-b51a-4d5f-b265-a6e01cb7f67c tempest-TestMinimumBasicScenario-327596405 None] attachment_update completed successfully. Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Acquiring lock "cinder-afd8906d-735a-49cc-bb3c-44a0090bb8f1-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-afd8906d-735a-49cc-bb3c-44a0090bb8f1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Acquiring lock "cinder-quobyte-afd8906d-735a-49cc-bb3c-44a0090bb8f1" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-quobyte-afd8906d-735a-49cc-bb3c-44a0090bb8f1" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[078aef8b-bf36-4531-aa82-b529b1d9d5aa]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:04 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 Jun 23 14:10:04 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:04 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" returned: 0 in 0.812s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-267960d6-a9b2-42c0-b18b-2b668f7d7c4f" released by "delete_volume" :: held 3.654s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Created reservations ['a17f5c09-9527-4956-ba5e-4bcb70f345d7', 'dafe3025-541d-4f49-b7c6-cbf88eb74a9a', 'cc0423da-e133-456f-9ceb-e9d5e90d0e55', 'f64a2220-1c9f-409c-a1aa-63ce6c5516d1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:04 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:10:04 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:04 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1" returned: 0 in 1.008s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:04 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1 Jun 23 14:10:04 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:05 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.839s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Deleted volume successfully. Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-11134888-c721-4c8e-b6ff-81bdb2dd94b7 tempest-VolumesExtendTest-575386631 None] Lock "cinder-267960d6-a9b2-42c0-b18b-2b668f7d7c4f-delete_volume" released by "delete_volume" :: held 4.936s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Flow 'volume_create_manager' (f40e93a7-6190-4944-816e-ee54eddc05e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c050914b-5ac2-46f0-ae91-8819681227b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c050914b-5ac2-46f0-ae91-8819681227b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-283626205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cb0735-976b-4af2-8d7c-b9dd87676d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0652023a6ead44a69c2dd496c427811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:06Z,use_quota=True,user_id='52aa3558e3a3430e85305e74eeb27165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0697a7-a52b-4445-bf44-86d2af34835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0697a7-a52b-4445-bf44-86d2af34835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092c489d-1a82-48f4-8de4-1e9c5d1fb84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092c489d-1a82-48f4-8de4-1e9c5d1fb84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11cb0735-976b-4af2-8d7c-b9dd87676d22', 'volume_name': 'volume-11cb0735-976b-4af2-8d7c-b9dd87676d22', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5445e6-98fb-4160-a3db-d6caedcebaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5445e6-98fb-4160-a3db-d6caedcebaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eff3ce4-c7f2-47cd-ae0b-4f257cce7421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:05 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Volume 11cb0735-976b-4af2-8d7c-b9dd87676d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11cb0735-976b-4af2-8d7c-b9dd87676d22', 'volume_size': 1} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-283626205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cb0735-976b-4af2-8d7c-b9dd87676d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0652023a6ead44a69c2dd496c427811f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:06Z,use_quota=True,user_id='52aa3558e3a3430e85305e74eeb27165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Creating volume 11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:05 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:05 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 1073741824 Jun 23 14:10:05 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:05 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-afd8906d-735a-49cc-bb3c-44a0090bb8f1" returned: 0 in 0.945s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-quobyte-afd8906d-735a-49cc-bb3c-44a0090bb8f1" released by "delete_volume" :: held 2.022s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:05 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Created reservations ['6a7a9620-a28e-472b-9875-e46ccd36ca7c', '55c4dd79-fb4f-43cf-9634-57708c30138d', '906cabd1-c13a-4abb-ab5f-96990efee0dc', '4662dac6-3a12-4527-90e2-361f227b2fb4'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:06 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:10:06 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:06 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 1073741824" returned: 0 in 1.173s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:06 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.900s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:06 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Deleted volume successfully. Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eeee9f4d-0596-4d66-8c84-47d015bb8eb7 tempest-VolumesTransfersV357Test-580299131 None] Lock "cinder-afd8906d-735a-49cc-bb3c-44a0090bb8f1-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:07 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 Jun 23 14:10:07 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:07 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eff3ce4-c7f2-47cd-ae0b-4f257cce7421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cb0735-976b-4af2-8d7c-b9dd87676d22', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d853ae-65cb-45d1-9b8b-3bc21db7f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:07 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Volume volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 (11cb0735-976b-4af2-8d7c-b9dd87676d22): created successfully Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d853ae-65cb-45d1-9b8b-3bc21db7f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Flow 'volume_create_manager' (f40e93a7-6190-4944-816e-ee54eddc05e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:07 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a246e567-f374-4281-9928-e1fcaeddd694 tempest-VolumesExtendTest-575386631 None] Created volume successfully. Jun 23 14:10:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Creating offline snapshot 6c411bd2-ab80-4611-a47c-776bd6c515a4 of volume 11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:09 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7bd24-7325-4c1e-80c0-6aa27708f0b7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:09 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 Jun 23 14:10:09 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:10 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22" returned: 0 in 1.246s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:10 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 1G Jun 23 14:10:10 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:12 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 1G" returned: 0 in 1.698s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:12 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 Jun 23 14:10:12 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:13 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4" returned: 0 in 1.635s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:13 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 is being set with open permissions: ugo+rw Jun 23 14:10:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:13 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 Jun 23 14:10:13 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Flow 'volume_create_manager' (54bb3c38-4c57-4446-ab3d-0c1423529656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6b07f7-f71a-4fca-9479-89c485f19697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6b07f7-f71a-4fca-9479-89c485f19697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1534139438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01d10ed-f2b8-410d-990e-d90a5759db9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23edaed903c4a65bc87dd999a1cf3c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:14Z,use_quota=True,user_id='01d7180077a84bb38a5618f0b41ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8820b826-caaa-4630-b5e1-cb7c5868919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8820b826-caaa-4630-b5e1-cb7c5868919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5154f673-333a-4f40-9e9e-c00f25487c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5154f673-333a-4f40-9e9e-c00f25487c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b01d10ed-f2b8-410d-990e-d90a5759db9b', 'volume_name': 'volume-b01d10ed-f2b8-410d-990e-d90a5759db9b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5635be-6198-4a06-96be-ec024894fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae5635be-6198-4a06-96be-ec024894fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e36f212-e9e5-462e-aeef-87677c3bb39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:14 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Volume b01d10ed-f2b8-410d-990e-d90a5759db9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b01d10ed-f2b8-410d-990e-d90a5759db9b', 'volume_size': 1} Jun 23 14:10:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:15 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4" returned: 0 in 1.187s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:15 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info Jun 23 14:10:15 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Flow 'volume_create_manager' (704dc9c9-80da-4f84-b29e-960810d2cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f174dc7-a19f-4a97-a98a-a6fc7d13f60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f174dc7-a19f-4a97-a98a-a6fc7d13f60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1569823785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0ad0d7-a5a0-433b-92c3-19ae160f6719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9f247b82914c05b134d8d0716aab6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:16Z,use_quota=True,user_id='d218af7c49ad45c1bd381c93ce7acbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129c6127-862b-49a0-8e45-17babdbf7a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129c6127-862b-49a0-8e45-17babdbf7a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148886b3-89a6-49a3-87e9-6c777bb186d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148886b3-89a6-49a3-87e9-6c777bb186d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'volume_name': 'volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a592a980-0f2b-4888-9433-8319759014a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a592a980-0f2b-4888-9433-8319759014a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:16 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f814f1-676f-40ab-9d88-33c3f91f7762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Volume ea0ad0d7-a5a0-433b-92c3-19ae160f6719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'volume_size': 1} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info" returned: 0 in 1.138s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:16 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info is being set with open permissions: ugo+rw Jun 23 14:10:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:16 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info Jun 23 14:10:16 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.info" returned: 0 in 0.908s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:17 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1534139438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01d10ed-f2b8-410d-990e-d90a5759db9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23edaed903c4a65bc87dd999a1cf3c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:14Z,use_quota=True,user_id='01d7180077a84bb38a5618f0b41ea104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Creating volume b01d10ed-f2b8-410d-990e-d90a5759db9b {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:17 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-be05db49-876e-421e-b809-0c74d8dbc0ff tempest-VolumesExtendTest-575386631 None] Create snapshot completed successfully Jun 23 14:10:17 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b 1073741824 Jun 23 14:10:17 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:18 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b 1073741824" returned: 0 in 1.132s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:18 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b Jun 23 14:10:18 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:19 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b" returned: 0 in 0.836s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.043s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1569823785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0ad0d7-a5a0-433b-92c3-19ae160f6719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9f247b82914c05b134d8d0716aab6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:16Z,use_quota=True,user_id='d218af7c49ad45c1bd381c93ce7acbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Creating volume ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:19 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e36f212-e9e5-462e-aeef-87677c3bb39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01d10ed-f2b8-410d-990e-d90a5759db9b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:19 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 1073741824 Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d092cf2-2bc1-47d7-9131-665195f42b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:19 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:19 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Volume volume-b01d10ed-f2b8-410d-990e-d90a5759db9b (b01d10ed-f2b8-410d-990e-d90a5759db9b): created successfully Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d092cf2-2bc1-47d7-9131-665195f42b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Flow 'volume_create_manager' (54bb3c38-4c57-4446-ab3d-0c1423529656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a68e9106-c533-43b0-a8ab-3a2fa760ab16 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Created volume successfully. Jun 23 14:10:20 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 1073741824" returned: 0 in 1.235s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:20 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:20 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:21 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 0.793s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.419s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f814f1-676f-40ab-9d88-33c3f91f7762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c49201-763c-44b9-84b2-ce677d28a02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a4c20e-1677-4ed9-bc3b-20acc3be76ba]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:21 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Volume volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 (ea0ad0d7-a5a0-433b-92c3-19ae160f6719): created successfully Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c49201-763c-44b9-84b2-ce677d28a02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:21 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Flow 'volume_create_manager' (704dc9c9-80da-4f84-b29e-960810d2cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d5ceaa60-a693-4a23-82dc-3b1c2e07d0a4 tempest-VolumesCloneTest-768311263 None] Created volume successfully. Jun 23 14:10:21 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 Jun 23 14:10:21 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:22 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22" returned: 0 in 1.007s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 2G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 2G" returned: 0 in 0.273s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.372s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:22 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-26465684-6009-4ef4-9fa0-66d4dfe42b58 tempest-VolumesExtendTest-575386631 None] Extend volume completed successfully. Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Flow 'volume_create_manager' (da5e9590-56f2-4595-9e05-f9a47031adf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1075dbb6-5a5b-46f0-8aad-8a37d1e2944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1075dbb6-5a5b-46f0-8aad-8a37d1e2944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1061884733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce7f947-4161-45ee-9ddd-141548034c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f9f247b82914c05b134d8d0716aab6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ea0ad0d7-a5a0-433b-92c3-19ae160f6719,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:23Z,use_quota=True,user_id='d218af7c49ad45c1bd381c93ce7acbcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe489df-8c57-40d6-9045-bdb0d93a9b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe489df-8c57-40d6-9045-bdb0d93a9b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211a9361-7c22-418e-86c9-c28e557752d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211a9361-7c22-418e-86c9-c28e557752d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8ce7f947-4161-45ee-9ddd-141548034c29', 'volume_name': 'volume-8ce7f947-4161-45ee-9ddd-141548034c29', 'volume_size': 2, 'source_volid': 'ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'source_volstatus': 'available'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839b0c05-d9d6-4a98-8dbc-63fc3f404d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839b0c05-d9d6-4a98-8dbc-63fc3f404d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a07f87d-a088-4546-a38e-5befd6e5909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:23 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Volume 8ce7f947-4161-45ee-9ddd-141548034c29: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8ce7f947-4161-45ee-9ddd-141548034c29', 'volume_size': 2, 'source_volid': 'ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'source_volstatus': 'available'} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:23 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Cloning volume ea0ad0d7-a5a0-433b-92c3-19ae160f6719 to volume 8ce7f947-4161-45ee-9ddd-141548034c29 Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Creating offline snapshot 50f3b6f6-6638-48a8-ae78-6d70c05c3c39 of volume ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa73ec-dd4e-42a7-ad24-be88ba2761df]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-6c411bd2-ab80-4611-a47c-776bd6c515a4-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Lock "cinder-6c411bd2-ab80-4611-a47c-776bd6c515a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-quobyte-11cb0735-976b-4af2-8d7c-b9dd87676d22" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-11cb0735-976b-4af2-8d7c-b9dd87676d22" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-quobyte-6c411bd2-ab80-4611-a47c-776bd6c515a4" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-6c411bd2-ab80-4611-a47c-776bd6c515a4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Deleting offline snapshot 6c411bd2-ab80-4611-a47c-776bd6c515a4 of volume 11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:23 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:23 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] snapshot_file for this snap is: volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7281f543-4675-4d77-b026-9faeccbd7d4d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:23 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 Jun 23 14:10:23 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:24 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 1.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:24 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 1G Jun 23 14:10:24 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:24 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4" returned: 0 in 0.931s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11cb0735-976b-4af2-8d7c-b9dd87676d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:24 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b370f-064a-43d2-b22b-e11da35cd8cd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:24 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 Jun 23 14:10:24 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:25 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 1G" returned: 0 in 1.041s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:25 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 Jun 23 14:10:25 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:25 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22" returned: 0 in 1.047s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:25 devstack sudo[109014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 Jun 23 14:10:25 devstack sudo[109014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:26 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39" returned: 0 in 0.949s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:26 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 is being set with open permissions: ugo+rw Jun 23 14:10:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:26 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 Jun 23 14:10:26 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:26 devstack sudo[109014]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4" returned: 0 in 1.045s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:26 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4 Jun 23 14:10:26 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:27 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39" returned: 0 in 0.848s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:27 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info Jun 23 14:10:27 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:27 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22.6c411bd2-ab80-4611-a47c-776bd6c515a4" returned: 0 in 0.785s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-6c411bd2-ab80-4611-a47c-776bd6c515a4" released by "_delete_snapshot" :: held 3.966s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-11cb0735-976b-4af2-8d7c-b9dd87676d22" released by "delete_snapshot" :: held 4.000s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Created reservations ['f529e1d5-dde9-4e76-85d6-8910ed832539', '304f3a46-773a-467b-b284-dc5a585c00ee', '3b40a0ad-8b5b-4d52-b8f5-d202684f3983', 'd9243fd7-246f-42b3-a091-e1fc35151ade'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Delete snapshot completed successfully. Jun 23 14:10:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a15eb2f6-c9a4-48b4-8c28-abe8ff2b5753 tempest-VolumesExtendTest-575386631 None] Lock "cinder-6c411bd2-ab80-4611-a47c-776bd6c515a4-delete_snapshot" released by "delete_snapshot" :: held 4.219s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-11cb0735-976b-4af2-8d7c-b9dd87676d22-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Lock "cinder-11cb0735-976b-4af2-8d7c-b9dd87676d22-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Acquiring lock "cinder-quobyte-11cb0735-976b-4af2-8d7c-b9dd87676d22" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-11cb0735-976b-4af2-8d7c-b9dd87676d22" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9946d-a6d1-4b96-91a8-7c909cb1560f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:28 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info" returned: 0 in 0.802s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:28 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info is being set with open permissions: ugo+rw Jun 23 14:10:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:28 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info Jun 23 14:10:28 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:28 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 Jun 23 14:10:28 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:29 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.info" returned: 0 in 0.744s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Acquiring lock "cinder-quobyte-8ce7f947-4161-45ee-9ddd-141548034c29" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-8ce7f947-4161-45ee-9ddd-141548034c29" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] snapshot: 50f3b6f6-6638-48a8-ae78-6d70c05c3c39, volume: 8ce7f947-4161-45ee-9ddd-141548034c29, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:10:29 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22" returned: 0 in 0.927s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be41088-7144-4415-bc0f-7c8f47301267]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:29 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22 Jun 23 14:10:29 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:29 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 Jun 23 14:10:29 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:30 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-11cb0735-976b-4af2-8d7c-b9dd87676d22" returned: 0 in 1.098s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Lock "cinder-quobyte-11cb0735-976b-4af2-8d7c-b9dd87676d22" released by "delete_volume" :: held 2.135s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Created reservations ['7eb67ef1-f336-4c06-b679-ebb0de91a3c9', 'a02c1847-cab9-4512-853e-ad7451e8b1f2', '5e1f1b3f-c460-4f4a-ba15-5b4203c94daf', '75fdbf51-e28e-4095-b0ea-1fd6842a38cc'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:30 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39" returned: 0 in 1.287s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[0196e3d7-d060-4fca-a55c-574285a6e420]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:30 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:10:30 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:30 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:30 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:31 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.089s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:31 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Deleted volume successfully. Jun 23 14:10:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f1490651-fd69-43b5-8723-e785f965b411 tempest-VolumesExtendTest-575386631 None] Lock "cinder-11cb0735-976b-4af2-8d7c-b9dd87676d22-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:31 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 1.286s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:31 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:10:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:31 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 Jun 23 14:10:31 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:40 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29" returned: 0 in 8.509s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9eedb5-6f82-4f50-ae87-cd5b08ea338b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:40 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:40 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:40 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:INSERT=10,cinder:UPDATE=48,cinder:DELETE=7,cinder:SELECT=36 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:10:41 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 1.204s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:41 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:10:41 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Converted 1024.00 MB image at 120.33 MB/s Jun 23 14:10:41 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 is being set with open permissions: ugo+rw Jun 23 14:10:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:41 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 Jun 23 14:10:41 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:41 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=67,cinder:INSERT=23,cinder:UPDATE=68,cinder:DELETE=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:10:42 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29" returned: 0 in 0.944s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-8ce7f947-4161-45ee-9ddd-141548034c29" released by "_copy_volume_from_snapshot" :: held 13.372s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Acquiring lock "cinder-quobyte-50f3b6f6-6638-48a8-ae78-6d70c05c3c39" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-50f3b6f6-6638-48a8-ae78-6d70c05c3c39" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Deleting offline snapshot 50f3b6f6-6638-48a8-ae78-6d70c05c3c39 of volume ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] snapshot_file for this snap is: volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[227aa70c-9270-46e5-932d-71e6ecb4ab92]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:42 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 Jun 23 14:10:42 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:43 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39" returned: 0 in 0.978s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:10:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3a27c-0ea9-4e0d-b9e9-615e6d85a5ca]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:43 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:43 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:44 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 0.999s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:44 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 Jun 23 14:10:44 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Flow 'volume_create_manager' (63027ab9-cad1-474b-a1ff-a33175ef071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6611d65c-c60a-47dc-9f82-761ac0d71751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6611d65c-c60a-47dc-9f82-761ac0d71751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1074973069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fe341f-7b49-41a7-8642-43c3940f4126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e080db75ab44aefabb005048b4256d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:45Z,use_quota=True,user_id='5a03875422184ab7872fbdb549cc4065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e646398-002e-4665-a889-1b7a8aac88da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e646398-002e-4665-a889-1b7a8aac88da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa7cc00-861c-4077-a071-fa37c91dc459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa7cc00-861c-4077-a071-fa37c91dc459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fe341f-7b49-41a7-8642-43c3940f4126', 'volume_name': 'volume-64fe341f-7b49-41a7-8642-43c3940f4126', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337b1af1-d5b3-4ce9-a35c-bdc038bb2534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337b1af1-d5b3-4ce9-a35c-bdc038bb2534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33af275e-afe2-44d0-9d59-6d67540ee88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:44 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Volume 64fe341f-7b49-41a7-8642-43c3940f4126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fe341f-7b49-41a7-8642-43c3940f4126', 'volume_size': 1} Jun 23 14:10:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:45 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39" returned: 0 in 0.899s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:45 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39 Jun 23 14:10:45 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:46 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719.50f3b6f6-6638-48a8-ae78-6d70c05c3c39" returned: 0 in 0.782s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-50f3b6f6-6638-48a8-ae78-6d70c05c3c39" released by "_delete_snapshot" :: held 3.792s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.859s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 22.852s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a07f87d-a088-4546-a38e-5befd6e5909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce7f947-4161-45ee-9ddd-141548034c29', 'volume_size': 2, 'source_volid': 'ea0ad0d7-a5a0-433b-92c3-19ae160f6719', 'source_volstatus': 'available'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c756898a-1e8d-46f3-a0df-8e0c1b1a03b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a61ccd9-bdd6-418d-b789-ee5e7a48c63a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:46 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Volume volume-8ce7f947-4161-45ee-9ddd-141548034c29 (8ce7f947-4161-45ee-9ddd-141548034c29): created successfully Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c756898a-1e8d-46f3-a0df-8e0c1b1a03b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Flow 'volume_create_manager' (da5e9590-56f2-4595-9e05-f9a47031adf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-42e01402-f020-4be2-ad3e-a8d9d0def1e4 tempest-VolumesCloneTest-768311263 None] Created volume successfully. Jun 23 14:10:46 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b Jun 23 14:10:46 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Acquiring lock "cinder-8ce7f947-4161-45ee-9ddd-141548034c29-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Lock "cinder-8ce7f947-4161-45ee-9ddd-141548034c29-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Acquiring lock "cinder-quobyte-8ce7f947-4161-45ee-9ddd-141548034c29" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-8ce7f947-4161-45ee-9ddd-141548034c29" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22a64b0-8093-45f3-9064-4e1e929634ac]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:47 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b" returned: 0 in 0.952s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.991s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1074973069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fe341f-7b49-41a7-8642-43c3940f4126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e080db75ab44aefabb005048b4256d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:45Z,use_quota=True,user_id='5a03875422184ab7872fbdb549cc4065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Creating volume 64fe341f-7b49-41a7-8642-43c3940f4126 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:47 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:47 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 1073741824 Jun 23 14:10:47 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-b01d10ed-f2b8-410d-990e-d90a5759db9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77e0d44c-6d63-4636-b7e9-7e571b63f7e0', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:10:47 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 Jun 23 14:10:47 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-585dcb44-45fb-4903-b56d-807c293cb19d req-78380ba6-cf3d-4bae-9e58-d6d0b6ce397f tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] attachment_update completed successfully. Jun 23 14:10:48 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29" returned: 0 in 1.029s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:48 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 1073741824" returned: 0 in 0.977s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:48 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29 Jun 23 14:10:48 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:48 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 Jun 23 14:10:48 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:49 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-8ce7f947-4161-45ee-9ddd-141548034c29" returned: 0 in 0.783s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-8ce7f947-4161-45ee-9ddd-141548034c29" released by "delete_volume" :: held 1.871s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:49 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126" returned: 0 in 0.788s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33af275e-afe2-44d0-9d59-6d67540ee88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fe341f-7b49-41a7-8642-43c3940f4126', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de41424-df39-4529-8354-ac8586904b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:49 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Volume volume-64fe341f-7b49-41a7-8642-43c3940f4126 (64fe341f-7b49-41a7-8642-43c3940f4126): created successfully Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de41424-df39-4529-8354-ac8586904b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Flow 'volume_create_manager' (63027ab9-cad1-474b-a1ff-a33175ef071b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Created reservations ['24fd0d00-ebd0-419d-84b2-6252d314b387', '461ba558-a0ff-4903-8ae3-c2f4808af152', '027a74eb-702e-47d6-8c59-fdd54fb465b8', '7f1dd4d4-a8e8-4e96-9a5b-13819d2bf34b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-85644ef7-83eb-4673-a3a1-3c2c2126e3fa tempest-VolumesNegativeTest-768181928 None] Created volume successfully. Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:49 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:10:49 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Acquiring lock "cinder-ea0ad0d7-a5a0-433b-92c3-19ae160f6719-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Lock "cinder-ea0ad0d7-a5a0-433b-92c3-19ae160f6719-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Acquiring lock "cinder-quobyte-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[07afc7e2-c1cf-4b10-8a2c-f5f2ef01fcb2]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:49 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:49 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:50 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:50 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Deleted volume successfully. Jun 23 14:10:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-391e9405-c92b-4453-994a-f5deac3b5556 tempest-VolumesCloneTest-768311263 None] Lock "cinder-8ce7f947-4161-45ee-9ddd-141548034c29-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:50 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 0.915s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:50 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719 Jun 23 14:10:50 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:51 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" returned: 0 in 0.831s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Lock "cinder-quobyte-ea0ad0d7-a5a0-433b-92c3-19ae160f6719" released by "delete_volume" :: held 1.827s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Created reservations ['e1bca78c-97bd-4e94-a5b4-9f2023ac9fa1', 'f9c805df-6c74-45eb-aefa-39a8a0e14cec', 'c89609c6-6d1a-4fa3-9a21-618c9e8830fe', '1bb89d7a-dcfd-4b23-a4d6-3924acb52443'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:51 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:10:51 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:51 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:10:51 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:52 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.077s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:10:52 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.170s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:10:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Deleted volume successfully. Jun 23 14:10:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e5621982-7bd2-4f7d-9f29-677bddb79417 tempest-VolumesCloneTest-768311263 None] Lock "cinder-ea0ad0d7-a5a0-433b-92c3-19ae160f6719-delete_volume" released by "delete_volume" :: held 3.275s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:10:56 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-c45e1d35-f4b3-4428-ae39-7a01dcfc1763 req-06d1956d-472a-4f84-aaff-18ce399cee2b tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Terminate volume connection completed successfully. Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-c45e1d35-f4b3-4428-ae39-7a01dcfc1763 req-06d1956d-472a-4f84-aaff-18ce399cee2b tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Deleting attachment 77e0d44c-6d63-4636-b7e9-7e571b63f7e0. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Flow 'volume_create_manager' (156e0bf6-e7ae-4ba4-9f38-d9d2bb73c6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9cfeb3-9fa2-408f-9960-9248b72007bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9cfeb3-9fa2-408f-9960-9248b72007bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1034220768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ba8f99-2776-4ef0-877d-89356b7a0d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3bf4e978894a3e9be9e7a5d4f548d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:56Z,use_quota=True,user_id='1e0958499fc94c83a8bf1169bca2a5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc26aae1-8613-4f04-ab44-2cb9eb4ccab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc26aae1-8613-4f04-ab44-2cb9eb4ccab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75320b99-9e05-42e0-9508-9ba0572efe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75320b99-9e05-42e0-9508-9ba0572efe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ba8f99-2776-4ef0-877d-89356b7a0d31', 'volume_name': 'volume-69ba8f99-2776-4ef0-877d-89356b7a0d31', 'volume_size': 2}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eee488a-3880-4e70-9a54-3057d6d932dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eee488a-3880-4e70-9a54-3057d6d932dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75c8336-915f-414b-a2c2-5aa64eec17e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:56 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Volume 69ba8f99-2776-4ef0-877d-89356b7a0d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ba8f99-2776-4ef0-877d-89356b7a0d31', 'volume_size': 2} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1034220768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ba8f99-2776-4ef0-877d-89356b7a0d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3bf4e978894a3e9be9e7a5d4f548d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:10:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:10:56Z,use_quota=True,user_id='1e0958499fc94c83a8bf1169bca2a5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Creating volume 69ba8f99-2776-4ef0-877d-89356b7a0d31 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:10:56 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:10:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 2147483648 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:56 devstack sudo[109315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 2147483648 Jun 23 14:10:56 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:57 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 2147483648" returned: 0 in 1.374s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:57 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 Jun 23 14:10:57 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Acquiring lock "cinder-b01d10ed-f2b8-410d-990e-d90a5759db9b-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "cinder-b01d10ed-f2b8-410d-990e-d90a5759db9b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Acquiring lock "cinder-quobyte-b01d10ed-f2b8-410d-990e-d90a5759db9b" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "cinder-quobyte-b01d10ed-f2b8-410d-990e-d90a5759db9b" acquired by "delete_volume" :: waited 0.051s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:58 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4139dc6b-ed21-4f3d-a5f7-dd63311fad89]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:58 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b Jun 23 14:10:58 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:59 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31" returned: 0 in 1.193s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] <== create_volume: return (2654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.659s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75c8336-915f-414b-a2c2-5aa64eec17e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ba8f99-2776-4ef0-877d-89356b7a0d31', 'volume_size': 2}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab9865f-de5e-44c7-91d0-090e807f73a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:10:59 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Volume volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 (69ba8f99-2776-4ef0-877d-89356b7a0d31): created successfully Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab9865f-de5e-44c7-91d0-090e807f73a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Flow 'volume_create_manager' (156e0bf6-e7ae-4ba4-9f38-d9d2bb73c6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:10:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-dee7f19d-65b4-4a0c-af39-83a2a6a94334 tempest-VolumesCloneNegativeTest-918286943 None] Created volume successfully. Jun 23 14:10:59 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b" returned: 0 in 1.288s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:10:59 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b Jun 23 14:10:59 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Acquiring lock "cinder-69ba8f99-2776-4ef0-877d-89356b7a0d31-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Lock "cinder-69ba8f99-2776-4ef0-877d-89356b7a0d31-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Acquiring lock "cinder-quobyte-69ba8f99-2776-4ef0-877d-89356b7a0d31" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Lock "cinder-quobyte-69ba8f99-2776-4ef0-877d-89356b7a0d31" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6641587-ef1d-4c94-8251-bdcfb4f9e42a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:10:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:00 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 Jun 23 14:11:00 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:00 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b01d10ed-f2b8-410d-990e-d90a5759db9b" returned: 0 in 1.147s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "cinder-quobyte-b01d10ed-f2b8-410d-990e-d90a5759db9b" released by "delete_volume" :: held 2.522s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:00 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Created reservations ['484524c0-ad87-4cf8-a034-fa331ccb2c14', 'a584ff06-076e-4270-b6a0-ec1f0e2b9a3e', 'bf0079fe-0847-4f16-ad03-b8c68f9a1010', '5e116085-27a9-44f1-8498-13285492ab0a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:01 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:11:01 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:01 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31" returned: 0 in 1.237s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:01 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31 Jun 23 14:11:01 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:02 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.294s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Deleted volume successfully. Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5893f084-bfe5-42e5-ba9a-568f1890b624 tempest-TestServerVolumeAttachScenarioOldVersion-1693618805 None] Lock "cinder-b01d10ed-f2b8-410d-990e-d90a5759db9b-delete_volume" released by "delete_volume" :: held 4.313s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:02 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69ba8f99-2776-4ef0-877d-89356b7a0d31" returned: 0 in 1.283s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Lock "cinder-quobyte-69ba8f99-2776-4ef0-877d-89356b7a0d31" released by "delete_volume" :: held 2.582s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Created reservations ['201fbd6b-f6b3-4816-b05d-cc720f57f6d7', '93c5ada1-ab32-4b78-90d5-c30bb8080dc1', 'cb43728a-e618-41b9-8e42-74bf376c80d7', 'dfcc7f71-f096-4aa3-a655-0ac3e8b3736f'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:02 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:11:02 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-207b7160-20d4-44e9-99f1-405c95783175 req-d3e3ed25-d727-4e28-bffb-c6fe41ae4ab5 tempest-TestMinimumBasicScenario-327596405 None] Terminate volume connection completed successfully. Jun 23 14:11:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-207b7160-20d4-44e9-99f1-405c95783175 req-d3e3ed25-d727-4e28-bffb-c6fe41ae4ab5 tempest-TestMinimumBasicScenario-327596405 None] Deleting attachment ea13d27c-f004-4f3b-aca6-f05371c38ff6. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:11:04 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.576s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:04 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Deleted volume successfully. Jun 23 14:11:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b40f78dd-6e38-459a-bdcd-78aa0abb0eed tempest-VolumesCloneNegativeTest-918286943 None] Lock "cinder-69ba8f99-2776-4ef0-877d-89356b7a0d31-delete_volume" released by "delete_volume" :: held 4.507s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Acquiring lock "cinder-6dccc34b-8bf6-49ad-807b-319f92928799-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Lock "cinder-6dccc34b-8bf6-49ad-807b-319f92928799-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Acquiring lock "cinder-quobyte-6dccc34b-8bf6-49ad-807b-319f92928799" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:06 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Lock "cinder-quobyte-6dccc34b-8bf6-49ad-807b-319f92928799" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce138f-51e8-4210-bfd9-95e683d20a14]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:06 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 Jun 23 14:11:06 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:08 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799" returned: 0 in 1.794s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:08 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799 Jun 23 14:11:08 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:09 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6dccc34b-8bf6-49ad-807b-319f92928799" returned: 0 in 1.259s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Lock "cinder-quobyte-6dccc34b-8bf6-49ad-807b-319f92928799" released by "delete_volume" :: held 3.137s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Created reservations ['8fedd0e7-f95c-4dcd-803b-31c370aefe71', '2a40f00c-6c7a-40a3-ad1b-5563e266eb5e', '667cde62-8eb6-4ef6-b59b-945f35c48859', '0ff5563a-b6ae-4d47-989c-06ceb71da801'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:09 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:11:09 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.604s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:11 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Deleted volume successfully. Jun 23 14:11:11 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f7cf594d-5b88-4bd8-a31f-88ee9272822f tempest-TestMinimumBasicScenario-327596405 None] Lock "cinder-6dccc34b-8bf6-49ad-807b-319f92928799-delete_volume" released by "delete_volume" :: held 5.256s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:19 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=54,cinder:SELECT=39,cinder:INSERT=12,cinder:DELETE=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:11:21 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=34,cinder:UPDATE=48,cinder:DELETE=6,cinder:INSERT=11 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:11:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Acquiring lock "cinder-64fe341f-7b49-41a7-8642-43c3940f4126-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Lock "cinder-64fe341f-7b49-41a7-8642-43c3940f4126-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Acquiring lock "cinder-quobyte-64fe341f-7b49-41a7-8642-43c3940f4126" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:11:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Lock "cinder-quobyte-64fe341f-7b49-41a7-8642-43c3940f4126" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:11:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6983c1fc-0fdc-4fb1-85c6-988c59c3aa0b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:11:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:36 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 Jun 23 14:11:36 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:37 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126" returned: 0 in 1.254s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:37 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126 Jun 23 14:11:37 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:38 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-64fe341f-7b49-41a7-8642-43c3940f4126" returned: 0 in 1.037s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Lock "cinder-quobyte-64fe341f-7b49-41a7-8642-43c3940f4126" released by "delete_volume" :: held 2.359s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Created reservations ['32b17ab6-b406-48a2-87c4-87d00541cfe5', '69d60580-4859-4791-a1d4-04952e75ca61', 'b11de39a-8655-4286-abde-9a1f9e292ccb', '49945942-47ff-488b-af81-983c1d710cfd'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:39 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:11:39 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:39 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.939s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:39 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:39 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Deleted volume successfully. Jun 23 14:11:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d995df4c-3af2-45a0-84a3-898dd1bffe92 tempest-VolumesNegativeTest-768181928 None] Lock "cinder-64fe341f-7b49-41a7-8642-43c3940f4126-delete_volume" released by "delete_volume" :: held 3.812s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:11:48 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:11:49 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:51 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:11:51 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:52 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.841s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:11:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:11:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:11:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Flow 'volume_create_manager' (2e229b39-d2e9-4d2c-93a1-da2547ef8313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4ce59f-2ed6-4fb7-9afd-6dc716519e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a4ce59f-2ed6-4fb7-9afd-6dc716519e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-994046916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e46795-6cf6-415f-bac8-c8b8b5fd0551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b95e75081b4619b2e344ce1b61f680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:56Z,use_quota=True,user_id='89122895520249fb993ab6477643d4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346323b5-de4f-41ad-85e4-7d7535020160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346323b5-de4f-41ad-85e4-7d7535020160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f253422e-3cef-47f3-9a98-49222cd621ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f253422e-3cef-47f3-9a98-49222cd621ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e46795-6cf6-415f-bac8-c8b8b5fd0551', 'volume_name': 'volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a911cf60-0d59-47db-a3cb-74ed69c8651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a911cf60-0d59-47db-a3cb-74ed69c8651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebec594-14bc-4386-8b53-a773d4b9126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:55 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Volume b7e46795-6cf6-415f-bac8-c8b8b5fd0551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551', 'volume_size': 1} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-994046916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e46795-6cf6-415f-bac8-c8b8b5fd0551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b95e75081b4619b2e344ce1b61f680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:11:56Z,use_quota=True,user_id='89122895520249fb993ab6477643d4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Creating volume b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:11:55 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:11:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:55 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 1073741824 Jun 23 14:11:55 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:56 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 1073741824" returned: 0 in 1.146s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:11:57 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:11:57 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:11:57 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 0.922s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebec594-14bc-4386-8b53-a773d4b9126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b8c453-f14a-42b1-8a9b-055f165ab0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:11:57 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Volume volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 (b7e46795-6cf6-415f-bac8-c8b8b5fd0551): created successfully Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b8c453-f14a-42b1-8a9b-055f165ab0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:11:57 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Flow 'volume_create_manager' (2e229b39-d2e9-4d2c-93a1-da2547ef8313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:11:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-223778b1-f01e-4309-8666-f3e963e7cc8a tempest-TestStampPattern-428640222 None] Created volume successfully. Jun 23 14:12:07 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=4 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:07 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Flow 'volume_create_manager' (23983cdc-f075-4539-82d2-5ed56478c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d69de8-4762-4cbc-a289-03967541bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d69de8-4762-4cbc-a289-03967541bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1508032355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc5a25e-901d-48d2-974f-16e5405a43a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311e663d53340cda8c2415e916137b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:12Z,use_quota=True,user_id='90214dc74fef42108aa2ad8990ce0781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4136f9e7-137d-4f5f-a1e0-ed5498fad0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4136f9e7-137d-4f5f-a1e0-ed5498fad0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02399d70-1066-48cf-aa0e-81046c7cf343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02399d70-1066-48cf-aa0e-81046c7cf343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc5a25e-901d-48d2-974f-16e5405a43a5', 'volume_name': 'volume-9fc5a25e-901d-48d2-974f-16e5405a43a5', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f56b1f-aa09-451c-a65a-e78c19496937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f56b1f-aa09-451c-a65a-e78c19496937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3affc540-b5df-4675-a710-660bb8b1a8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Volume 9fc5a25e-901d-48d2-974f-16e5405a43a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc5a25e-901d-48d2-974f-16e5405a43a5', 'volume_size': 1} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1508032355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc5a25e-901d-48d2-974f-16e5405a43a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311e663d53340cda8c2415e916137b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:12Z,use_quota=True,user_id='90214dc74fef42108aa2ad8990ce0781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Creating volume 9fc5a25e-901d-48d2-974f-16e5405a43a5 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:12:11 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:12:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:11 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 1073741824 Jun 23 14:12:11 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Flow 'volume_create_manager' (c4f06de9-ef50-46a1-b4b7-594b2be27c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8c43e-8639-416e-8d4d-03d0d7733eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8c43e-8639-416e-8d4d-03d0d7733eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-66968955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1cee49-22a3-4669-bd84-676b587825ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311e663d53340cda8c2415e916137b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:12Z,use_quota=True,user_id='90214dc74fef42108aa2ad8990ce0781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9a1579-7d19-4c7a-8068-8830c88ae484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9a1579-7d19-4c7a-8068-8830c88ae484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32be23d7-6dd9-4592-b147-51e633cf1cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32be23d7-6dd9-4592-b147-51e633cf1cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1cee49-22a3-4669-bd84-676b587825ca', 'volume_name': 'volume-ee1cee49-22a3-4669-bd84-676b587825ca', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46c5026-acab-43cc-a0fa-fe2c3c66d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46c5026-acab-43cc-a0fa-fe2c3c66d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13643bed-e7b9-4a46-9b42-f349e0162ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:12 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Volume ee1cee49-22a3-4669-bd84-676b587825ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1cee49-22a3-4669-bd84-676b587825ca', 'volume_size': 1} Jun 23 14:12:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:13 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 1073741824" returned: 0 in 1.258s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:13 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 Jun 23 14:12:13 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:14 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5" returned: 0 in 0.934s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] <== create_volume: return (2300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-66968955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1cee49-22a3-4669-bd84-676b587825ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b311e663d53340cda8c2415e916137b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:12Z,use_quota=True,user_id='90214dc74fef42108aa2ad8990ce0781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Creating volume ee1cee49-22a3-4669-bd84-676b587825ca {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:12:14 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3affc540-b5df-4675-a710-660bb8b1a8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc5a25e-901d-48d2-974f-16e5405a43a5', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:14 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca 1073741824 Jun 23 14:12:14 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2296422-6cdd-48b8-a16e-c92d742c047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:14 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Volume volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 (9fc5a25e-901d-48d2-974f-16e5405a43a5): created successfully Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2296422-6cdd-48b8-a16e-c92d742c047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Flow 'volume_create_manager' (23983cdc-f075-4539-82d2-5ed56478c01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4af09d34-92cd-42cf-971b-4b217bd0c875 tempest-TestServerVolumeAttachmentScenario-971161973 None] Created volume successfully. Jun 23 14:12:15 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca 1073741824" returned: 0 in 1.247s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:15 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca Jun 23 14:12:15 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:16 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca" returned: 0 in 0.793s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13643bed-e7b9-4a46-9b42-f349e0162ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1cee49-22a3-4669-bd84-676b587825ca', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0824182d-2cb3-4f34-8eb1-53fbc86e5113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Volume volume-ee1cee49-22a3-4669-bd84-676b587825ca (ee1cee49-22a3-4669-bd84-676b587825ca): created successfully Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0824182d-2cb3-4f34-8eb1-53fbc86e5113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Flow 'volume_create_manager' (c4f06de9-ef50-46a1-b4b7-594b2be27c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-3a603712-c44e-42da-8819-3b02a521aa51 tempest-TestServerVolumeAttachmentScenario-971161973 None] Created volume successfully. Jun 23 14:12:26 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:26 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Flow 'volume_create_manager' (355fb8ee-538e-42c2-bfe2-de77768b7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c7632a-a7da-43be-84bc-7f2fbae3993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c7632a-a7da-43be-84bc-7f2fbae3993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1714323838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9833720-3eec-423a-ab22-6d8df79d6bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12c191628cd452ebd98b79604464920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:30Z,use_quota=True,user_id='34471d7b2cdf4541a74554860f3d8e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f12d4a2-df12-4867-9c77-e912b0f11501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f12d4a2-df12-4867-9c77-e912b0f11501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becf25f3-fa60-440c-98e7-70267b264bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:30 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becf25f3-fa60-440c-98e7-70267b264bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9833720-3eec-423a-ab22-6d8df79d6bdc', 'volume_name': 'volume-f9833720-3eec-423a-ab22-6d8df79d6bdc', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa0e3f6-ed75-4cb4-ace9-255cd6b11950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa0e3f6-ed75-4cb4-ace9-255cd6b11950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097c9e01-7f28-490c-bc43-d9d51f09cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Volume f9833720-3eec-423a-ab22-6d8df79d6bdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9833720-3eec-423a-ab22-6d8df79d6bdc', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Trying to clone f9833720-3eec-423a-ab22-6d8df79d6bdc from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:12:31 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Image download 20.69 MB at 20.69 MB/s Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[adafc0a9-82fc-4bf9-8b8d-a3e6a8585b4f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:31 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD Jun 23 14:12:31 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:32 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:32 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d is fetched for user 34471d7b2cdf4541a74554860f3d8e9f. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:12:32 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[360737bb-26a2-4ff6-b453-db4f553fcf95]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:32 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD Jun 23 14:12:32 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:33 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD" returned: 0 in 1.153s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1714323838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9833720-3eec-423a-ab22-6d8df79d6bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12c191628cd452ebd98b79604464920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:12:30Z,use_quota=True,user_id='34471d7b2cdf4541a74554860f3d8e9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Creating volume f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:12:33 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:12:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:33 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc 1073741824 Jun 23 14:12:33 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:35 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc 1073741824" returned: 0 in 1.144s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:35 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:12:35 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:36 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 1.226s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:12:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.427s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:36 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Attempting download of c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume f9833720-3eec-423a-ab22-6d8df79d6bdc. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:12:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1682ad3e-c0b3-45ff-aed3-1b203743a2a4]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:36 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko Jun 23 14:12:36 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:37 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko" returned: 0 in 1.242s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:37 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko Jun 23 14:12:37 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:38 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko" returned: 1 in 1.136s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_z_kbbzko' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:38 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c08b99e-b616-4bb1-9641-27acd70a77d4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:39 devstack sudo[109996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD Jun 23 14:12:39 devstack sudo[109996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:39 devstack sudo[109996]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:39 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d was qcow2, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:12:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:39 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:12:39 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:42 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 2.755s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:42 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d_gw4eh9cldevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:12:42 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Converted 112.00 MB image at 40.64 MB/s Jun 23 14:12:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:42 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc 1G Jun 23 14:12:42 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:43 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc 1G" returned: 0 in 0.825s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f461e1-37d9-4ea5-aeef-5413e76b8b2d]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:43 devstack sudo[110054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:12:43 devstack sudo[110054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:44 devstack sudo[110054]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 0.851s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:44 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:12:44 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=4 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:45 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 1 in 0.841s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Downloaded image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d ((None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}])) to volume f9833720-3eec-423a-ab22-6d8df79d6bdc successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Temporary image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d for user 34471d7b2cdf4541a74554860f3d8e9f is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Marking volume f9833720-3eec-423a-ab22-6d8df79d6bdc as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Copying metadata from image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d to f9833720-3eec-423a-ab22-6d8df79d6bdc. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Creating volume glance metadata for volume f9833720-3eec-423a-ab22-6d8df79d6bdc backed by image c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097c9e01-7f28-490c-bc43-d9d51f09cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9833720-3eec-423a-ab22-6d8df79d6bdc', 'volume_size': 1, 'image_id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b5eb881717ae4ef0b5fbe11831d2b083', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d', 'created_at': datetime.datetime(2026, 6, 23, 11, 46, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 46, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0dc1ebd-0bf1-46b9-9dc3-efc20fd2270d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6961c26a-0b1a-4fc7-ad7e-530ad6b53182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:12:45 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Volume volume-f9833720-3eec-423a-ab22-6d8df79d6bdc (f9833720-3eec-423a-ab22-6d8df79d6bdc): created successfully Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6961c26a-0b1a-4fc7-ad7e-530ad6b53182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:12:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Flow 'volume_create_manager' (355fb8ee-538e-42c2-bfe2-de77768b7625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:12:45 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-11d177a2-f4b0-4fed-abc5-20c97a841b82 tempest-TestShelveInstance-748766386 None] Created volume successfully. Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:51 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:12:51 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:52 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.839s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:12:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:12:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:12:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:12:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:53 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cb5744-78d7-43cd-9a3f-0d78246d0a42]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:54 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:12:54 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:54 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 0.977s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:54 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:12:54 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:55 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=6,cinder:SELECT=8,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:12:55 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 1 in 0.831s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:12:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.891s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:55 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-f9833720-3eec-423a-ab22-6d8df79d6bdc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94deb95a-1cac-43ff-85c6-c12885589fad', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:12:55 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-4b6ebf21-4c25-4c2e-9b5f-ddb8f337bcda req-6599982c-0824-4be2-915a-416633f7871d tempest-TestShelveInstance-748766386 None] attachment_update completed successfully. Jun 23 14:12:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:12:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:12:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d906ba0-86c7-4f29-bbc3-9b140890eff9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:12:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:12:57 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:12:57 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:12:58 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Jun 23 14:12:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 0.969s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:12:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:12:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb55dab6-4c05-4571-91f4-3bff598dc953', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:12:58 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-00a9a592-71e3-4931-ba67-779b90d8d020 req-67df1edf-a2dd-482c-befb-06d9abd36cbf tempest-TestStampPattern-428640222 None] attachment_update completed successfully. Jun 23 14:13:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[010762db-4094-4313-a16f-54f5d2215b48]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:06 devstack sudo[110633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 Jun 23 14:13:06 devstack sudo[110633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:07 devstack sudo[110633]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5" returned: 0 in 1.219s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.250s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-9fc5a25e-901d-48d2-974f-16e5405a43a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4973aa2c-8837-47e9-bf83-b164d503e327', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:13:08 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-dd4f242a-625b-4238-82e6-24702a6b54f2 req-a6529269-a81e-4614-85ec-1ff8ba9e2728 tempest-TestServerVolumeAttachmentScenario-971161973 None] attachment_update completed successfully. Jun 23 14:13:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-342094b5-dd26-4b9b-8934-3ed34c1033b5 req-49f2607d-b6bc-4508-b929-3c3b73c9ea9b tempest-TestStampPattern-428640222 None] Terminate volume connection completed successfully. Jun 23 14:13:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-342094b5-dd26-4b9b-8934-3ed34c1033b5 req-49f2607d-b6bc-4508-b929-3c3b73c9ea9b tempest-TestStampPattern-428640222 None] Deleting attachment fb55dab6-4c05-4571-91f4-3bff598dc953. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:13:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Creating offline snapshot 8239323e-f714-4012-8123-343eb37e6763 of volume b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:13:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dca9a9-4ff7-4b44-8ff9-e75363e48eb3]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:11 devstack sudo[110655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:13:11 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:12 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 0.933s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:12 devstack sudo[110660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 1G Jun 23 14:13:12 devstack sudo[110660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:13 devstack sudo[110660]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 1G" returned: 0 in 0.937s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:13 devstack sudo[110666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 Jun 23 14:13:13 devstack sudo[110666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:14 devstack sudo[110666]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763" returned: 0 in 0.854s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:14 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 is being set with open permissions: ugo+rw Jun 23 14:13:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:14 devstack sudo[110672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 Jun 23 14:13:14 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:15 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763" returned: 0 in 0.863s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:15 devstack sudo[110675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info Jun 23 14:13:15 devstack sudo[110675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:15 devstack sudo[110675]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info" returned: 0 in 0.770s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:15 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info is being set with open permissions: ugo+rw Jun 23 14:13:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:15 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info Jun 23 14:13:15 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:16 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.info" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e18f98a0-df80-430b-8ed3-799ba9d94488 tempest-TestStampPattern-428640222 None] Create snapshot completed successfully Jun 23 14:13:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8efc42-692c-4b8f-8fd8-df738307ef63]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:18 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca Jun 23 14:13:18 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:19 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca" returned: 0 in 0.936s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.959s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-ee1cee49-22a3-4669-bd84-676b587825ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f59f1c1-7abd-42bf-92a6-46398c11ac05', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:13:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-529fed9f-3627-43e0-8553-6624c23b0eee req-0864867f-c723-45e1-9840-946fe5afa6f6 tempest-TestServerVolumeAttachmentScenario-971161973 None] attachment_update completed successfully. Jun 23 14:13:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-bc586f7a-47d9-41d4-b7a1-bb95838b733e req-2605e539-a6c3-44fc-a868-21bd034dbf38 tempest-TestServerVolumeAttachmentScenario-971161973 None] Terminate volume connection completed successfully. Jun 23 14:13:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-bc586f7a-47d9-41d4-b7a1-bb95838b733e req-2605e539-a6c3-44fc-a868-21bd034dbf38 tempest-TestServerVolumeAttachmentScenario-971161973 None] Deleting attachment 3f59f1c1-7abd-42bf-92a6-46398c11ac05. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Flow 'volume_create_manager' (a270573f-85fd-4f4d-a923-ac81e10189f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a41d9c0-461a-4d15-9835-36120f7fa002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a41d9c0-461a-4d15-9835-36120f7fa002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1473775759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69637566-077e-4ec9-94b9-2d22d1fb03ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16b95e75081b4619b2e344ce1b61f680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8239323e-f714-4012-8123-343eb37e6763,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:13:29Z,use_quota=True,user_id='89122895520249fb993ab6477643d4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839f7ba0-e272-4a4a-950c-24768a224777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (839f7ba0-e272-4a4a-950c-24768a224777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21314c8d-a377-495a-a8fe-db6723a136c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21314c8d-a377-495a-a8fe-db6723a136c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69637566-077e-4ec9-94b9-2d22d1fb03ea', 'volume_name': 'volume-69637566-077e-4ec9-94b9-2d22d1fb03ea', 'volume_size': 1, 'snapshot_id': '8239323e-f714-4012-8123-343eb37e6763'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96d26bf-1cc7-45a9-b340-21cd7edd2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96d26bf-1cc7-45a9-b340-21cd7edd2122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa534df0-c869-4433-ad13-ce22bcf21206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:29 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Volume 69637566-077e-4ec9-94b9-2d22d1fb03ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69637566-077e-4ec9-94b9-2d22d1fb03ea', 'volume_size': 1, 'snapshot_id': '8239323e-f714-4012-8123-343eb37e6763'} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-quobyte-8239323e-f714-4012-8123-343eb37e6763-69637566-077e-4ec9-94b9-2d22d1fb03ea" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-8239323e-f714-4012-8123-343eb37e6763-69637566-077e-4ec9-94b9-2d22d1fb03ea" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Creating volume 69637566-077e-4ec9-94b9-2d22d1fb03ea from snapshot 8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-quobyte-69637566-077e-4ec9-94b9-2d22d1fb03ea" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-69637566-077e-4ec9-94b9-2d22d1fb03ea" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] snapshot: 8239323e-f714-4012-8123-343eb37e6763, volume: 69637566-077e-4ec9-94b9-2d22d1fb03ea, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed1477-dfc3-4987-bbe5-c90892ea65c9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:30 devstack sudo[110883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 Jun 23 14:13:30 devstack sudo[110883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-721165f5-9cc8-4f87-bc29-b71fb0222cba req-c29db257-99f1-40ce-b18e-f655b7ada598 tempest-TestServerVolumeAttachmentScenario-971161973 None] Terminate volume connection completed successfully. Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-721165f5-9cc8-4f87-bc29-b71fb0222cba req-c29db257-99f1-40ce-b18e-f655b7ada598 tempest-TestServerVolumeAttachmentScenario-971161973 None] Deleting attachment 4973aa2c-8837-47e9-bf83-b164d503e327. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:13:30 devstack sudo[110883]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763" returned: 0 in 1.112s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[216666cd-135f-4bc4-9881-50e3374e55ca]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:31 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:13:31 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:32 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 1.234s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:32 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:13:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:32 devstack sudo[110928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea Jun 23 14:13:32 devstack sudo[110928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:39 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=10,cinder:SELECT=28,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:13:40 devstack sudo[110928]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea" returned: 0 in 7.806s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d0bc2-272d-4a76-9bf7-845955c80850]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:40 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:13:40 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:40 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=9,cinder:SELECT=40,cinder:INSERT=6 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:13:41 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 1.742s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:41 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:13:41 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Converted 1024.00 MB image at 131.07 MB/s Jun 23 14:13:41 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea is being set with open permissions: ugo+rw Jun 23 14:13:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:41 devstack sudo[111043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea Jun 23 14:13:41 devstack sudo[111043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-1514b7db-5c16-40a3-ae6e-05b9a9a26411 req-c7df2464-f5ee-459c-89c5-e5735d08f9ab tempest-TestShelveInstance-748766386 None] Terminate volume connection completed successfully. Jun 23 14:13:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-1514b7db-5c16-40a3-ae6e-05b9a9a26411 req-c7df2464-f5ee-459c-89c5-e5735d08f9ab tempest-TestShelveInstance-748766386 None] Deleting attachment 94deb95a-1cac-43ff-85c6-c12885589fad. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:13:42 devstack sudo[111043]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea" returned: 0 in 1.024s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-69637566-077e-4ec9-94b9-2d22d1fb03ea" released by "_copy_volume_from_snapshot" :: held 13.108s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-8239323e-f714-4012-8123-343eb37e6763-69637566-077e-4ec9-94b9-2d22d1fb03ea" released by "_create_volume_from_snapshot" :: held 13.154s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.187s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa534df0-c869-4433-ad13-ce22bcf21206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69637566-077e-4ec9-94b9-2d22d1fb03ea', 'volume_size': 1, 'snapshot_id': '8239323e-f714-4012-8123-343eb37e6763'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb84b87-d3cf-40b6-a336-3c4b221dd56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:13:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Volume volume-69637566-077e-4ec9-94b9-2d22d1fb03ea (69637566-077e-4ec9-94b9-2d22d1fb03ea): created successfully Jun 23 14:13:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb84b87-d3cf-40b6-a336-3c4b221dd56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:13:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Flow 'volume_create_manager' (a270573f-85fd-4f4d-a923-ac81e10189f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:13:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f20dd041-89c9-4341-8776-46a91ab8225f tempest-TestStampPattern-428640222 None] Created volume successfully. Jun 23 14:13:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "cinder-ee1cee49-22a3-4669-bd84-676b587825ca-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-ee1cee49-22a3-4669-bd84-676b587825ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "cinder-quobyte-ee1cee49-22a3-4669-bd84-676b587825ca" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-quobyte-ee1cee49-22a3-4669-bd84-676b587825ca" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1165f6-4a2b-401e-9bcc-33281bc5bd65]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:46 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca Jun 23 14:13:46 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:46 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca" returned: 0 in 0.900s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:46 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca Jun 23 14:13:46 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:47 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ee1cee49-22a3-4669-bd84-676b587825ca" returned: 0 in 0.830s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-quobyte-ee1cee49-22a3-4669-bd84-676b587825ca" released by "delete_volume" :: held 1.794s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd18eb21-a32d-4c7c-a6f3-4dffb16968a6]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Created reservations ['b12b0e59-5747-45a9-9261-93df0dbc3028', '9743436e-5741-4088-855e-2767e97cf1f4', 'd017866d-46cf-4a07-a587-a8f45178a6c9', '90021087-7a00-4f4c-b0b3-699d3627f978'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:47 devstack sudo[111124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:13:47 devstack sudo[111124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:47 devstack sudo[111126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:13:47 devstack sudo[111126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "cinder-9fc5a25e-901d-48d2-974f-16e5405a43a5-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-9fc5a25e-901d-48d2-974f-16e5405a43a5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "cinder-quobyte-9fc5a25e-901d-48d2-974f-16e5405a43a5" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-quobyte-9fc5a25e-901d-48d2-974f-16e5405a43a5" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1654c86-5bfa-4153-baed-e00e89c71c4a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:48 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 Jun 23 14:13:48 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:48 devstack sudo[111126]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.924s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Deleted volume successfully. Jun 23 14:13:48 devstack sudo[111124]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ff2ce488-93a0-4200-a362-3d646a2ae5f8 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-ee1cee49-22a3-4669-bd84-676b587825ca-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:49 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:13:49 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:49 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5" returned: 0 in 1.116s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:49 devstack sudo[111155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5 Jun 23 14:13:49 devstack sudo[111155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:50 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 1 in 1.251s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.373s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-f9833720-3eec-423a-ab22-6d8df79d6bdc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0af868ae-fd2d-48c4-ad68-2b59a5684741', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:13:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-50bdf8c2-4bf6-4281-a9c9-0ce75a606c77 req-44f44de9-0a52-4d1c-ba0d-c233e910778b tempest-TestShelveInstance-748766386 None] attachment_update completed successfully. Jun 23 14:13:50 devstack sudo[111155]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-9fc5a25e-901d-48d2-974f-16e5405a43a5" returned: 0 in 1.126s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-quobyte-9fc5a25e-901d-48d2-974f-16e5405a43a5" released by "delete_volume" :: held 2.315s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Created reservations ['ace29cfd-4d1f-4d8e-b05d-491b5721968e', 'd85b6c26-2aaa-4780-b3af-2a8733b67754', 'b42358bb-d369-4802-a731-7c8c42a3a417', '54e785f2-b984-415b-8ac8-2db47f47134b'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:50 devstack sudo[111201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:13:50 devstack sudo[111201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:51 devstack sudo[111201]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.779s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Deleted volume successfully. Jun 23 14:13:51 devstack sudo[111207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:13:51 devstack sudo[111207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:13:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b7134c3-58e8-43c9-b378-d4c7bfd67f67 tempest-TestServerVolumeAttachmentScenario-971161973 None] Lock "cinder-9fc5a25e-901d-48d2-974f-16e5405a43a5-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:13:52 devstack sudo[111207]: pam_unix(sudo:session): session closed for user root Jun 23 14:13:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.028s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:13:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:13:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:13:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:13:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:14:00 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=4 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:14:01 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Flow 'volume_create_manager' (ba39706a-3c98-43c8-a875-b1bd89cca3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d2aad9-5c4a-4baf-9d18-cd1ce02c0e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d2aad9-5c4a-4baf-9d18-cd1ce02c0e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce76156-1bb6-4629-80c3-4e9d54c20b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5732fd8d70df4de1a40973ea17759d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:12Z,use_quota=True,user_id='1ce1b46b5ca4468cb7f8241c9b4e3de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5af9a896-ee4e-4f6d-97bd-902b17615afd),volume_type_id=5af9a896-ee4e-4f6d-97bd-902b17615afd)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555b2b63-0898-4f6b-bbed-c40f1a27a1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555b2b63-0898-4f6b-bbed-c40f1a27a1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe825fed-0f4a-4023-bb33-baacc824f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe825fed-0f4a-4023-bb33-baacc824f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ce76156-1bb6-4629-80c3-4e9d54c20b4d', 'volume_name': 'volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d', 'volume_size': 1, 'image_id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69d0c62a-6fed-4ff8-80e1-4750b4451467', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4130322510912c50c0137a4eee3c8881', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5732fd8d70df4de1a40973ea17759d44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6c2f628781c72be0b9bbb94316ac3b882201e215c693c4d63f612c3491a1c9a2466b5a7e9e0ca3d16d8dde83bdb9b5c39c2f42f695d634f6824b2a9a2ee39cb', 'id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'created_at': datetime.datetime(2026, 6, 23, 12, 14, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69d0c62a-6fed-4ff8-80e1-4750b4451467/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9019151-3845-43b9-91c5-7a4b8c114c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9019151-3845-43b9-91c5-7a4b8c114c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f464314c-65c6-4046-a4a6-cf119ee100a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:12 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Volume 1ce76156-1bb6-4629-80c3-4e9d54c20b4d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d', 'volume_size': 1, 'image_id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69d0c62a-6fed-4ff8-80e1-4750b4451467', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4130322510912c50c0137a4eee3c8881', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5732fd8d70df4de1a40973ea17759d44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6c2f628781c72be0b9bbb94316ac3b882201e215c693c4d63f612c3491a1c9a2466b5a7e9e0ca3d16d8dde83bdb9b5c39c2f42f695d634f6824b2a9a2ee39cb', 'id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'created_at': datetime.datetime(2026, 6, 23, 12, 14, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69d0c62a-6fed-4ff8-80e1-4750b4451467/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Trying to clone 1ce76156-1bb6-4629-80c3-4e9d54c20b4d from image 69d0c62a-6fed-4ff8-80e1-4750b4451467 at location (None, [{'url': 'file:///opt/stack/data/glance/images/69d0c62a-6fed-4ff8-80e1-4750b4451467', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:14:12 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:14:12 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:14:13 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6b781-7564-4683-a792-0e2f3172315f]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:13 devstack sudo[111701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD Jun 23 14:14:13 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:13 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:13 devstack sudo[111706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD Jun 23 14:14:13 devstack sudo[111706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:14 devstack sudo[111706]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD" returned: 1 in 0.840s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:14 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Temporary image 69d0c62a-6fed-4ff8-80e1-4750b4451467 is fetched for user 1ce1b46b5ca4468cb7f8241c9b4e3de4. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:14:14 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf1ab6-c2cd-4ff1-83da-6bc21edc96a6]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:14 devstack sudo[111711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD Jun 23 14:14:14 devstack sudo[111711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:15 devstack sudo[111711]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:15 devstack sudo[111715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD Jun 23 14:14:15 devstack sudo[111715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:16 devstack sudo[111715]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD" returned: 1 in 0.845s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce76156-1bb6-4629-80c3-4e9d54c20b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5732fd8d70df4de1a40973ea17759d44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:14:12Z,use_quota=True,user_id='1ce1b46b5ca4468cb7f8241c9b4e3de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5af9a896-ee4e-4f6d-97bd-902b17615afd),volume_type_id=5af9a896-ee4e-4f6d-97bd-902b17615afd)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Creating volume 1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:14:16 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:14:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:16 devstack sudo[111720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d 1073741824 Jun 23 14:14:16 devstack sudo[111720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:17 devstack sudo[111720]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d 1073741824" returned: 0 in 1.253s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:17 devstack sudo[111728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:17 devstack sudo[111728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:18 devstack sudo[111728]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 0 in 0.719s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:14:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:18 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Attempting download of 69d0c62a-6fed-4ff8-80e1-4750b4451467 ((None, [{'url': 'file:///opt/stack/data/glance/images/69d0c62a-6fed-4ff8-80e1-4750b4451467', 'metadata': {}}])) to volume 1ce76156-1bb6-4629-80c3-4e9d54c20b4d. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:14:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189024e-94e2-4478-a0a2-f10aa0129888]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:18 devstack sudo[111731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt Jun 23 14:14:18 devstack sudo[111731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:19 devstack sudo[111731]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt" returned: 0 in 0.920s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:19 devstack sudo[111739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt Jun 23 14:14:19 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:20 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt" returned: 1 in 0.890s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69d0c62a-6fed-4ff8-80e1-4750b4451467_d2oe3zdt' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:20 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[294bc565-e188-4ef6-a4bf-d20a79683d69]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:20 devstack sudo[111746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD Jun 23 14:14:20 devstack sudo[111746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:21 devstack sudo[111746]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:21 devstack sudo[111750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD Jun 23 14:14:21 devstack sudo[111750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:22 devstack sudo[111750]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD" returned: 1 in 0.868s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] 69d0c62a-6fed-4ff8-80e1-4750b4451467 was raw, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:22 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:22 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a7de84-7511-4086-a614-7c9b93428ede]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:23 devstack sudo[111796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea Jun 23 14:14:23 devstack sudo[111796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:23 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 0 in 0.877s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:23 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69d0c62a-6fed-4ff8-80e1-4750b4451467_y9pgscljdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:14:23 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:14:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:23 devstack sudo[111798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d 1G Jun 23 14:14:23 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:23 devstack sudo[111796]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea" returned: 0 in 1.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.055s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412', 'name': 'volume-69637566-077e-4ec9-94b9-2d22d1fb03ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c649b19b-d57c-4593-8943-3bcc506b0dca', 'enforce_multipath': True} {{(pid=93605) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 14:14:24 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d 1G" returned: 0 in 0.955s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-6a55d742-03a9-4962-87a8-e3f367bd60dc req-26ba21bf-ceaf-43da-bfda-ecd22e377fa8 tempest-TestStampPattern-428640222 None] attachment_update completed successfully. Jun 23 14:14:24 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1217c0-ab11-44bd-b53b-59d9f2e1143f]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:24 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:24 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:25 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 0 in 0.928s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:25 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:25 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:26 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 1 in 1.021s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Downloaded image 69d0c62a-6fed-4ff8-80e1-4750b4451467 ((None, [{'url': 'file:///opt/stack/data/glance/images/69d0c62a-6fed-4ff8-80e1-4750b4451467', 'metadata': {}}])) to volume 1ce76156-1bb6-4629-80c3-4e9d54c20b4d successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Temporary image 69d0c62a-6fed-4ff8-80e1-4750b4451467 for user 1ce1b46b5ca4468cb7f8241c9b4e3de4 is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Marking volume 1ce76156-1bb6-4629-80c3-4e9d54c20b4d as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Copying metadata from image 69d0c62a-6fed-4ff8-80e1-4750b4451467 to 1ce76156-1bb6-4629-80c3-4e9d54c20b4d. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Creating volume glance metadata for volume 1ce76156-1bb6-4629-80c3-4e9d54c20b4d backed by image 69d0c62a-6fed-4ff8-80e1-4750b4451467 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4130322510912c50c0137a4eee3c8881', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f464314c-65c6-4046-a4a6-cf119ee100a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d', 'volume_size': 1, 'image_id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69d0c62a-6fed-4ff8-80e1-4750b4451467', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4130322510912c50c0137a4eee3c8881', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5732fd8d70df4de1a40973ea17759d44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6c2f628781c72be0b9bbb94316ac3b882201e215c693c4d63f612c3491a1c9a2466b5a7e9e0ca3d16d8dde83bdb9b5c39c2f42f695d634f6824b2a9a2ee39cb', 'id': '69d0c62a-6fed-4ff8-80e1-4750b4451467', 'created_at': datetime.datetime(2026, 6, 23, 12, 14, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69d0c62a-6fed-4ff8-80e1-4750b4451467/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f746aafd-59a1-4595-b97c-f59814b4f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:14:26 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Volume volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d (1ce76156-1bb6-4629-80c3-4e9d54c20b4d): created successfully Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f746aafd-59a1-4595-b97c-f59814b4f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Flow 'volume_create_manager' (ba39706a-3c98-43c8-a875-b1bd89cca3b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:14:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-210e85d5-773f-4043-85a0-6682d88e2bf6 tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Created volume successfully. Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Acquiring lock "cinder-1ce76156-1bb6-4629-80c3-4e9d54c20b4d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "cinder-1ce76156-1bb6-4629-80c3-4e9d54c20b4d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Acquiring lock "cinder-quobyte-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "cinder-quobyte-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0f300-b5f2-453e-aff3-5523dbbf4104]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:26 devstack sudo[111821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:26 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:27 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 0 in 0.919s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:27 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:27 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:28 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 1 in 0.857s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:28 devstack sudo[111831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d Jun 23 14:14:28 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:29 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" returned: 0 in 0.734s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "cinder-quobyte-1ce76156-1bb6-4629-80c3-4e9d54c20b4d" released by "delete_volume" :: held 2.597s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:29 devstack cinder-volume[93605]: WARNING cinder.quota [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:14:29 devstack cinder-volume[93605]: WARNING cinder.quota [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Created reservations ['f1347259-ade5-4c9a-8458-fe0f852de912', 'ec772417-aa42-4295-9e78-afccbc13f7b3', 'e4da1d76-79af-4801-9e1f-bcbb79e53a47', 'e71c82df-cd01-41cb-9fdd-2ef76c6a6b30'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:29 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:14:29 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:30 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.955s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:30 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Deleted volume successfully. Jun 23 14:14:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c5361e8-3fc8-4826-ab5a-393325fd230f tempest-VolumeAndVolumeTypeFromImageTest-292372338 None] Lock "cinder-1ce76156-1bb6-4629-80c3-4e9d54c20b4d-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-a5193f0f-1784-4e68-8e92-a7fa4ace6d3a req-acabf775-c1a9-4c0a-8345-6b40f96b51f0 tempest-TestStampPattern-428640222 None] Terminate volume connection completed successfully. Jun 23 14:14:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-a5193f0f-1784-4e68-8e92-a7fa4ace6d3a req-acabf775-c1a9-4c0a-8345-6b40f96b51f0 tempest-TestStampPattern-428640222 None] Deleting attachment c649b19b-d57c-4593-8943-3bcc506b0dca. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:14:40 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=19,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:14:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-69637566-077e-4ec9-94b9-2d22d1fb03ea-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Lock "cinder-69637566-077e-4ec9-94b9-2d22d1fb03ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-quobyte-69637566-077e-4ec9-94b9-2d22d1fb03ea" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-69637566-077e-4ec9-94b9-2d22d1fb03ea" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:41 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5c68a-657f-4888-8302-f8c4d38d3ff9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:41 devstack sudo[111918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea Jun 23 14:14:41 devstack sudo[111918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:42 devstack sudo[111918]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea" returned: 0 in 0.824s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:42 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea Jun 23 14:14:42 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:43 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-69637566-077e-4ec9-94b9-2d22d1fb03ea" returned: 0 in 0.752s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-69637566-077e-4ec9-94b9-2d22d1fb03ea" released by "delete_volume" :: held 1.645s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Created reservations ['5a70bb33-ae7a-4d8e-9b95-f6d75cf12c91', '135447ae-8e34-4369-b10b-6257f0451940', '9c4aa835-783c-45bd-87e2-a1b6681e79ca', '9a019799-9167-473f-8756-69abf3741dc4'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:43 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:14:43 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:44 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.873s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Deleted volume successfully. Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-52ac98eb-ef78-4d92-b057-a5984b95a2c2 tempest-TestStampPattern-428640222 None] Lock "cinder-69637566-077e-4ec9-94b9-2d22d1fb03ea-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-8239323e-f714-4012-8123-343eb37e6763-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Lock "cinder-8239323e-f714-4012-8123-343eb37e6763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-quobyte-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-quobyte-8239323e-f714-4012-8123-343eb37e6763" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-8239323e-f714-4012-8123-343eb37e6763" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Deleting offline snapshot 8239323e-f714-4012-8123-343eb37e6763 of volume b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] snapshot_file for this snap is: volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa80aa-d4b0-43ea-8463-1fffcfaba8bd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:44 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 Jun 23 14:14:44 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:45 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763" returned: 0 in 1.050s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:14:45 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3ea5a3-eb82-4929-8006-2efdb39267ff]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:45 devstack sudo[111992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:14:45 devstack sudo[111992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:46 devstack sudo[111992]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 1.013s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:46 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 Jun 23 14:14:46 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:47 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763" returned: 0 in 0.978s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:47 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763 Jun 23 14:14:47 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:48 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551.8239323e-f714-4012-8123-343eb37e6763" returned: 0 in 0.692s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-8239323e-f714-4012-8123-343eb37e6763" released by "_delete_snapshot" :: held 3.879s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" released by "delete_snapshot" :: held 3.909s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Created reservations ['2b327aa2-1f51-4efb-b60b-09b2eb03902f', '2ec4c8e1-0588-4bf9-9cf5-075fa85e7381', '83b78783-2eea-42b4-8bd7-77cc587b5606', '79e1c68d-d7fc-4acb-a06e-3d205bc7cca2'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Delete snapshot completed successfully. Jun 23 14:14:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-85fda21b-393e-442e-8b96-d70535fe82f4 tempest-TestStampPattern-428640222 None] Lock "cinder-8239323e-f714-4012-8123-343eb37e6763-delete_snapshot" released by "delete_snapshot" :: held 4.235s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-74a118d0-4379-40f4-812a-9df6d5dc5f70 tempest-TestShelveInstance-748766386 None] Terminate volume connection completed successfully. Jun 23 14:14:49 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-74a118d0-4379-40f4-812a-9df6d5dc5f70 tempest-TestShelveInstance-748766386 None] Deleting attachment 0af868ae-fd2d-48c4-ad68-2b59a5684741. {{(pid=93605) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 14:14:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Acquiring lock "cinder-f9833720-3eec-423a-ab22-6d8df79d6bdc-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Lock "cinder-f9833720-3eec-423a-ab22-6d8df79d6bdc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Acquiring lock "cinder-quobyte-f9833720-3eec-423a-ab22-6d8df79d6bdc" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Lock "cinder-quobyte-f9833720-3eec-423a-ab22-6d8df79d6bdc" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:50 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72e5132-3e69-48bb-a6c6-7c898a43ee04]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:50 devstack sudo[112052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:14:50 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:51 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 1.025s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:51 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:14:51 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:51 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:14:51 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:52 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.773s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:14:52 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 1 in 0.915s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:14:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:52 devstack sudo[112107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc Jun 23 14:14:52 devstack sudo[112107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:53 devstack sudo[112107]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f9833720-3eec-423a-ab22-6d8df79d6bdc" returned: 0 in 0.712s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Lock "cinder-quobyte-f9833720-3eec-423a-ab22-6d8df79d6bdc" released by "delete_volume" :: held 2.720s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG cinder.quota [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Created reservations ['46166a6a-d739-4276-b9e5-fa0637580019', '6496dc94-f2a8-49f5-a2f6-57634d2515bc', 'b7da6c8e-03c0-453b-b6ce-15c436f8cf21', 'cb6d8876-2f09-490b-baf1-cabbea85d611'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:53 devstack sudo[112112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:14:53 devstack sudo[112112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:54 devstack sudo[112112]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.874s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:54 devstack cinder-volume[93605]: DEBUG cinder.manager [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:14:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Deleted volume successfully. Jun 23 14:14:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [req-34208fb0-401e-49ae-b867-ddd59c05b257 req-253a4b94-ddf9-4343-9a6f-304febc12fe8 tempest-TestShelveInstance-748766386 None] Lock "cinder-f9833720-3eec-423a-ab22-6d8df79d6bdc-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-b7e46795-6cf6-415f-bac8-c8b8b5fd0551-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Lock "cinder-b7e46795-6cf6-415f-bac8-c8b8b5fd0551-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Acquiring lock "cinder-quobyte-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:14:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:14:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c121b-3c0a-46d0-a8d8-d78a796308b5]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:14:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:57 devstack sudo[112116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:14:57 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:58 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 0.849s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:58 devstack sudo[112122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551 Jun 23 14:14:58 devstack sudo[112122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:14:59 devstack sudo[112122]: pam_unix(sudo:session): session closed for user root Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" returned: 0 in 0.775s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Lock "cinder-quobyte-b7e46795-6cf6-415f-bac8-c8b8b5fd0551" released by "delete_volume" :: held 1.706s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Created reservations ['fa11ac17-34b4-4dd9-a4a6-f77d7b68cd44', 'fb0dc012-ce3b-484b-b105-37205eada9eb', 'd685905d-8c5e-472a-bd2f-cb8d5ccfa5f0', 'cf2f64f6-ea5d-410d-8269-5218aea6c1b1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:14:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:14:59 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:14:59 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:00 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:00 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:00 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Deleted volume successfully. Jun 23 14:15:00 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ec0bf142-4a66-43f7-933f-e654f44f2f01 tempest-TestStampPattern-428640222 None] Lock "cinder-b7e46795-6cf6-415f-bac8-c8b8b5fd0551-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=44,cinder:SELECT=42,cinder:INSERT=20,cinder:DELETE=3 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (89a391d2-84b8-48a7-8ebf-003612edbe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff941e47-c9f5-4ce5-89f2-0c57e017d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff941e47-c9f5-4ce5-89f2-0c57e017d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270872756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c67f2bb-480c-478d-8a58-91d32d9ed695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:07Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370eb22e-22cb-4edc-a8a3-151d6b0c6fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370eb22e-22cb-4edc-a8a3-151d6b0c6fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b75f1-5281-4a9a-8165-cd1e1ff11a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467b75f1-5281-4a9a-8165-cd1e1ff11a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c67f2bb-480c-478d-8a58-91d32d9ed695', 'volume_name': 'volume-5c67f2bb-480c-478d-8a58-91d32d9ed695', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d1ad68-970f-4631-a7c0-c72c17fd0518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d1ad68-970f-4631-a7c0-c72c17fd0518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1e9a35-776a-4047-afee-4a93357a7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:06 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Volume 5c67f2bb-480c-478d-8a58-91d32d9ed695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c67f2bb-480c-478d-8a58-91d32d9ed695', 'volume_size': 1} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270872756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c67f2bb-480c-478d-8a58-91d32d9ed695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:07Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Creating volume 5c67f2bb-480c-478d-8a58-91d32d9ed695 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:07 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:07 devstack sudo[112143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 1073741824 Jun 23 14:15:07 devstack sudo[112143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (8998c66b-9328-4877-a8b4-34a6ef1e717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c23682-b5f3-4029-abbf-2a146959a5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c23682-b5f3-4029-abbf-2a146959a5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-300924369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a1fbc4-0865-49f9-9a36-8b576196305e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:07Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836c92a9-c91c-4172-9718-1d0e64bd1321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836c92a9-c91c-4172-9718-1d0e64bd1321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f46f1e-fdd1-4a74-871c-1f808fb39dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f46f1e-fdd1-4a74-871c-1f808fb39dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a1fbc4-0865-49f9-9a36-8b576196305e', 'volume_name': 'volume-12a1fbc4-0865-49f9-9a36-8b576196305e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e14d53-5884-4528-828a-05c001b2d355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e14d53-5884-4528-828a-05c001b2d355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f533b6c-d7b1-4297-97fb-db0726325275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Volume 12a1fbc4-0865-49f9-9a36-8b576196305e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a1fbc4-0865-49f9-9a36-8b576196305e', 'volume_size': 1} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (ef7e3e4f-67a1-4d9c-ad38-a29aac41b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d36f79-9427-48fe-beb3-376f32a0ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d36f79-9427-48fe-beb3-376f32a0ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413120151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4219167f-fb12-4e4b-ac49-e5b81caa7886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:08Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f37b4f-af13-468a-9999-3c611329a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f37b4f-af13-468a-9999-3c611329a78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4a009b-e080-4bea-971b-7a1197c2647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4a009b-e080-4bea-971b-7a1197c2647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4219167f-fb12-4e4b-ac49-e5b81caa7886', 'volume_name': 'volume-4219167f-fb12-4e4b-ac49-e5b81caa7886', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035479e5-742b-45f1-ac2b-d4508d193f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035479e5-742b-45f1-ac2b-d4508d193f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d87448-a8dd-4ea3-b190-0dad707ae931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:07 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Volume 4219167f-fb12-4e4b-ac49-e5b81caa7886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4219167f-fb12-4e4b-ac49-e5b81caa7886', 'volume_size': 1} Jun 23 14:15:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:08 devstack sudo[112143]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 1073741824" returned: 0 in 1.269s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:08 devstack sudo[112149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 Jun 23 14:15:08 devstack sudo[112149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (b23660b3-635f-4a48-8c77-477dd5546734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0ef086-5874-4502-93a4-b83b6ec5269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0ef086-5874-4502-93a4-b83b6ec5269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-583150155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1900fe-4651-40a1-89b2-9d49290a9011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:08Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffafb80-4be7-4cd1-8c71-8a8d4289f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffafb80-4be7-4cd1-8c71-8a8d4289f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7dca46-ad3c-4f29-ac43-f63f8a9e5e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7dca46-ad3c-4f29-ac43-f63f8a9e5e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1900fe-4651-40a1-89b2-9d49290a9011', 'volume_name': 'volume-fa1900fe-4651-40a1-89b2-9d49290a9011', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdcc353-9641-4f9b-8675-7d7094c622f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdcc353-9641-4f9b-8675-7d7094c622f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926fc379-8472-4066-b4c6-7f8c39548dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:08 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Volume fa1900fe-4651-40a1-89b2-9d49290a9011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1900fe-4651-40a1-89b2-9d49290a9011', 'volume_size': 1} Jun 23 14:15:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (9e5d2b28-7d90-41b8-b181-74b6b4f6c9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d6f86a-15b4-44d6-a3cc-41288f83a4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d6f86a-15b4-44d6-a3cc-41288f83a4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359675636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1211945d-6972-4fcf-a5cb-da3c4e32c901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:09Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b56235-d541-4772-94fa-dbcd84f789c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b56235-d541-4772-94fa-dbcd84f789c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b6f63e-4966-4bd8-971e-3f190bc846a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b6f63e-4966-4bd8-971e-3f190bc846a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1211945d-6972-4fcf-a5cb-da3c4e32c901', 'volume_name': 'volume-1211945d-6972-4fcf-a5cb-da3c4e32c901', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3694fd8f-2fbe-4844-b1f5-c025a7f15913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3694fd8f-2fbe-4844-b1f5-c025a7f15913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e609a461-6f08-4247-a017-5ee33d8c929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:09 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Volume 1211945d-6972-4fcf-a5cb-da3c4e32c901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1211945d-6972-4fcf-a5cb-da3c4e32c901', 'volume_size': 1} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:09 devstack sudo[112149]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695" returned: 0 in 1.022s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] <== create_volume: return (2374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.379s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.884s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-300924369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a1fbc4-0865-49f9-9a36-8b576196305e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:07Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Creating volume 12a1fbc4-0865-49f9-9a36-8b576196305e {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:09 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1e9a35-776a-4047-afee-4a93357a7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c67f2bb-480c-478d-8a58-91d32d9ed695', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595e97fc-483f-4e75-8004-ff7aa3358170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:09 devstack sudo[112152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e 1073741824 Jun 23 14:15:09 devstack sudo[112152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:09 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Volume volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 (5c67f2bb-480c-478d-8a58-91d32d9ed695): created successfully Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595e97fc-483f-4e75-8004-ff7aa3358170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:09 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (89a391d2-84b8-48a7-8ebf-003612edbe29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:09 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2ac61208-1512-496b-b8fa-a5f4e88a960f tempest-CreateVolumesFromImageTest-1594856443 None] Created volume successfully. Jun 23 14:15:10 devstack sudo[112152]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e 1073741824" returned: 0 in 1.086s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:10 devstack sudo[112159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e Jun 23 14:15:10 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:11 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e" returned: 0 in 0.799s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.439s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-413120151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4219167f-fb12-4e4b-ac49-e5b81caa7886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:08Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Creating volume 4219167f-fb12-4e4b-ac49-e5b81caa7886 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:11 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f533b6c-d7b1-4297-97fb-db0726325275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a1fbc4-0865-49f9-9a36-8b576196305e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e00627-5640-4f3c-aae9-c94a204d4c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:11 devstack sudo[112162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 1073741824 Jun 23 14:15:11 devstack sudo[112162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Volume volume-12a1fbc4-0865-49f9-9a36-8b576196305e (12a1fbc4-0865-49f9-9a36-8b576196305e): created successfully Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e00627-5640-4f3c-aae9-c94a204d4c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (8998c66b-9328-4877-a8b4-34a6ef1e717d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:11 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c93c33de-ab10-4610-a450-c2cd489055fe tempest-CreateVolumesFromImageTest-1594856443 None] Created volume successfully. Jun 23 14:15:12 devstack sudo[112162]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 1073741824" returned: 0 in 1.096s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:12 devstack sudo[112169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 Jun 23 14:15:12 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:13 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886" returned: 0 in 0.761s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.573s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-583150155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1900fe-4651-40a1-89b2-9d49290a9011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:08Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Creating volume fa1900fe-4651-40a1-89b2-9d49290a9011 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:13 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:13 devstack sudo[112172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 1073741824 Jun 23 14:15:13 devstack sudo[112172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d87448-a8dd-4ea3-b190-0dad707ae931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4219167f-fb12-4e4b-ac49-e5b81caa7886', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9118042f-d786-4367-b58f-048af6d67656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Volume volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 (4219167f-fb12-4e4b-ac49-e5b81caa7886): created successfully Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9118042f-d786-4367-b58f-048af6d67656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (ef7e3e4f-67a1-4d9c-ad38-a29aac41b656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:13 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-12934c02-caa4-4e6d-b327-abbb3a84f452 tempest-CreateVolumesFromImageTest-1594856443 None] Created volume successfully. Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (2c6ba524-ab1a-4a59-981e-c7bd626a31d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cb5000-52ab-4a2e-a6e8-4884ae7ae21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cb5000-52ab-4a2e-a6e8-4884ae7ae21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757167848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50677b4e-d9b6-4ffa-8e59-af4feace9b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:14Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e54c0a-5328-4e72-b7b4-e2ded13070c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e54c0a-5328-4e72-b7b4-e2ded13070c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bcf852-b1cb-494c-804e-73279b42ea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bcf852-b1cb-494c-804e-73279b42ea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50677b4e-d9b6-4ffa-8e59-af4feace9b96', 'volume_name': 'volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e578f2-6527-4c51-a2c2-8fbf76002d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e578f2-6527-4c51-a2c2-8fbf76002d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e339d0b4-1f4a-46c2-ae45-68a7cda0b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:13 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume 50677b4e-d9b6-4ffa-8e59-af4feace9b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96', 'volume_size': 1} Jun 23 14:15:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:14 devstack sudo[112172]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 1073741824" returned: 0 in 0.946s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:14 devstack sudo[112180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 Jun 23 14:15:14 devstack sudo[112180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:14 devstack sudo[112180]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011" returned: 0 in 0.689s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.790s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-359675636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1211945d-6972-4fcf-a5cb-da3c4e32c901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4be41327dd744e04a52aaab3b8e9bdf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:09Z,use_quota=True,user_id='b95ce781edc04e47a0b2a7d962de5c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Creating volume 1211945d-6972-4fcf-a5cb-da3c4e32c901 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:14 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926fc379-8472-4066-b4c6-7f8c39548dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1900fe-4651-40a1-89b2-9d49290a9011', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:14 devstack sudo[112183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 1073741824 Jun 23 14:15:14 devstack sudo[112183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2516517a-a7cb-4850-a05e-75d0051f7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:15 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Volume volume-fa1900fe-4651-40a1-89b2-9d49290a9011 (fa1900fe-4651-40a1-89b2-9d49290a9011): created successfully Jun 23 14:15:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2516517a-a7cb-4850-a05e-75d0051f7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (b23660b3-635f-4a48-8c77-477dd5546734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:15 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8ea9b0e5-10a8-4106-aa2d-b917273a8405 tempest-CreateVolumesFromImageTest-1594856443 None] Created volume successfully. Jun 23 14:15:15 devstack sudo[112183]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 1073741824" returned: 0 in 0.901s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:15 devstack sudo[112189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 Jun 23 14:15:15 devstack sudo[112189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:16 devstack sudo[112189]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901" returned: 0 in 0.660s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.688s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757167848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50677b4e-d9b6-4ffa-8e59-af4feace9b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:14Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating volume 50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:16 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:16 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 1073741824 Jun 23 14:15:16 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e609a461-6f08-4247-a017-5ee33d8c929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1211945d-6972-4fcf-a5cb-da3c4e32c901', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c88f1e-3597-4d6c-8fb2-1eaff14168b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Volume volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 (1211945d-6972-4fcf-a5cb-da3c4e32c901): created successfully Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c88f1e-3597-4d6c-8fb2-1eaff14168b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Flow 'volume_create_manager' (9e5d2b28-7d90-41b8-b181-74b6b4f6c9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0ac33b29-320d-49bd-8b96-5fb3c4105243 tempest-CreateVolumesFromImageTest-1594856443 None] Created volume successfully. Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-1211945d-6972-4fcf-a5cb-da3c4e32c901-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-1211945d-6972-4fcf-a5cb-da3c4e32c901-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-quobyte-1211945d-6972-4fcf-a5cb-da3c4e32c901" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-1211945d-6972-4fcf-a5cb-da3c4e32c901" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8382b2b3-00c3-441c-b599-de6d5044ec6a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:17 devstack sudo[112194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 Jun 23 14:15:17 devstack sudo[112194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:17 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 1073741824" returned: 0 in 0.913s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:17 devstack sudo[112200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 Jun 23 14:15:17 devstack sudo[112200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:17 devstack sudo[112194]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901" returned: 0 in 0.844s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:17 devstack sudo[112205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901 Jun 23 14:15:17 devstack sudo[112205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:18 devstack sudo[112200]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96" returned: 0 in 0.668s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e339d0b4-1f4a-46c2-ae45-68a7cda0b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5164b9e-cc66-47ba-b339-f9b9e0a96c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:18 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 (50677b4e-d9b6-4ffa-8e59-af4feace9b96): created successfully Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5164b9e-cc66-47ba-b339-f9b9e0a96c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (2c6ba524-ab1a-4a59-981e-c7bd626a31d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:18 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9544e372-8cfe-4e96-bf5d-89a69d09b6c9 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created volume successfully. Jun 23 14:15:18 devstack sudo[112205]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-1211945d-6972-4fcf-a5cb-da3c4e32c901" returned: 0 in 0.720s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-1211945d-6972-4fcf-a5cb-da3c4e32c901" released by "delete_volume" :: held 1.616s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Created reservations ['9d1cbad2-556b-4f5c-936d-818fc385b075', 'f3c2a7ab-92ad-4c44-a2f9-89a000904661', '546ac766-2b6c-467e-9712-ad3582c5e35e', '15365978-0feb-47b5-87b4-0a50d722ffc0'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:18 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:18 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-fa1900fe-4651-40a1-89b2-9d49290a9011-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-fa1900fe-4651-40a1-89b2-9d49290a9011-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-quobyte-fa1900fe-4651-40a1-89b2-9d49290a9011" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-fa1900fe-4651-40a1-89b2-9d49290a9011" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21a700f-05a3-4f71-ab3a-853d56d96f66]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating offline snapshot ee804cd1-d8cb-4363-82bf-7b3598f0bb04 of volume 50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e5f376-6456-450f-8ea8-b593a0ac4802]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:19 devstack sudo[112211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 Jun 23 14:15:19 devstack sudo[112211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:19 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Deleted volume successfully. Jun 23 14:15:19 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-08ec0bb0-d870-4c91-a806-e3b346e186df tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-1211945d-6972-4fcf-a5cb-da3c4e32c901-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:19 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 Jun 23 14:15:19 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:20 devstack sudo[112211]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011" returned: 0 in 0.960s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:20 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96" returned: 0 in 0.804s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:20 devstack sudo[112222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011 Jun 23 14:15:20 devstack sudo[112222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:20 devstack sudo[112223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 1G Jun 23 14:15:20 devstack sudo[112223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:20 devstack sudo[112222]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fa1900fe-4651-40a1-89b2-9d49290a9011" returned: 0 in 0.759s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-fa1900fe-4651-40a1-89b2-9d49290a9011" released by "delete_volume" :: held 1.769s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Created reservations ['5eb28e3b-020e-454b-88ec-f29be1c633eb', '19e268b7-480d-4505-874c-7f7c8bc81fe4', 'c4a415e2-1c6b-4567-a485-273daa892d9d', '66ff6e96-0fed-4681-b943-487eec1794de'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:21 devstack sudo[112231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:21 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:21 devstack sudo[112223]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 1G" returned: 0 in 0.976s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:21 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 Jun 23 14:15:21 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-4219167f-fb12-4e4b-ac49-e5b81caa7886-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-4219167f-fb12-4e4b-ac49-e5b81caa7886-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-quobyte-4219167f-fb12-4e4b-ac49-e5b81caa7886" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-4219167f-fb12-4e4b-ac49-e5b81caa7886" acquired by "delete_volume" :: waited 0.050s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ae837b-cd86-4baf-9772-797f19c12a9b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:21 devstack sudo[112235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 Jun 23 14:15:21 devstack sudo[112235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:21 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.799s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:21 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:21 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Deleted volume successfully. Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b58ce6f8-c7fb-4355-877e-6de7ec85132b tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-fa1900fe-4651-40a1-89b2-9d49290a9011-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:22 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04" returned: 0 in 0.851s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:22 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 is being set with open permissions: ugo+rw Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:22 devstack sudo[112241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 Jun 23 14:15:22 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:22 devstack sudo[112235]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886" returned: 0 in 0.908s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:22 devstack sudo[112246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886 Jun 23 14:15:22 devstack sudo[112246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:22 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04" returned: 0 in 0.728s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:22 devstack sudo[112249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info Jun 23 14:15:22 devstack sudo[112249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:23 devstack sudo[112246]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-4219167f-fb12-4e4b-ac49-e5b81caa7886" returned: 0 in 0.757s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-4219167f-fb12-4e4b-ac49-e5b81caa7886" released by "delete_volume" :: held 1.714s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Created reservations ['161df873-9a42-4e70-9e13-239337ec54d0', '8d501420-6e18-4724-9399-6c54ab326973', '17d514bc-97c8-4ec5-87d4-e848f94d43f6', 'de44f606-3f34-4ec0-adae-c2d74a3ebf9e'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:23 devstack sudo[112253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:23 devstack sudo[112253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:23 devstack sudo[112249]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info" returned: 0 in 0.755s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:23 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info is being set with open permissions: ugo+rw Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:23 devstack sudo[112256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info Jun 23 14:15:23 devstack sudo[112256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-12a1fbc4-0865-49f9-9a36-8b576196305e-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-12a1fbc4-0865-49f9-9a36-8b576196305e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-quobyte-12a1fbc4-0865-49f9-9a36-8b576196305e" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-12a1fbc4-0865-49f9-9a36-8b576196305e" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[823daa5b-bfce-43d7-89bd-84e45fb0467c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:24 devstack sudo[112258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e Jun 23 14:15:24 devstack sudo[112258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:24 devstack sudo[112253]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.776s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Deleted volume successfully. Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-453a48d0-1226-48e4-9bf3-a36076df127d tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-4219167f-fb12-4e4b-ac49-e5b81caa7886-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:24 devstack sudo[112256]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.info" returned: 0 in 0.805s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.034s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ede03b04-5c95-4383-99e9-fb2cb11e12cb tempest-CreateVolumesFromSnapshotTest-598247247 None] Create snapshot completed successfully Jun 23 14:15:24 devstack sudo[112258]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e" returned: 0 in 0.901s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:24 devstack sudo[112265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e Jun 23 14:15:24 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (0744cc48-08f2-4770-b82d-befc0352fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ba8d2e-e4d8-407f-a1ef-09e63557bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52ba8d2e-e4d8-407f-a1ef-09e63557bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1711530777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea30ea7-e06d-473d-8acf-62b1c93a8a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:25Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe13b46-0ed2-4972-b1c7-38803b49b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe13b46-0ed2-4972-b1c7-38803b49b86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80476c64-b03d-44e4-82d6-a7dd31bc5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80476c64-b03d-44e4-82d6-a7dd31bc5f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea30ea7-e06d-473d-8acf-62b1c93a8a3f', 'volume_name': 'volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5be0a8-dc81-47e6-a333-73754add08b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5be0a8-dc81-47e6-a333-73754add08b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e772d9b1-116a-4ef9-85ab-524a2863200e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume eea30ea7-e06d-473d-8acf-62b1c93a8a3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f', 'volume_size': 1} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1711530777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea30ea7-e06d-473d-8acf-62b1c93a8a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:25Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating volume eea30ea7-e06d-473d-8acf-62b1c93a8a3f {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:25 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:25 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f 1073741824 Jun 23 14:15:25 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:25 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12a1fbc4-0865-49f9-9a36-8b576196305e" returned: 0 in 0.786s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-12a1fbc4-0865-49f9-9a36-8b576196305e" released by "delete_volume" :: held 1.756s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (2e71cd70-9933-4b4e-824c-aa19c063f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ece3b8c-7bfe-435a-a773-26b918208d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ece3b8c-7bfe-435a-a773-26b918208d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921613442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f6e7d1-6356-467e-8a9e-e81012b25879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:26Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e41fe0-1221-4662-8d84-c6fe6892e8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e41fe0-1221-4662-8d84-c6fe6892e8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b54f55-088b-4f75-baba-6cf2e5e356b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b54f55-088b-4f75-baba-6cf2e5e356b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f6e7d1-6356-467e-8a9e-e81012b25879', 'volume_name': 'volume-06f6e7d1-6356-467e-8a9e-e81012b25879', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c696e9-39b6-4b44-a616-f53006a116a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c696e9-39b6-4b44-a616-f53006a116a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52ba80b-266d-479f-b593-a9771a60660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume 06f6e7d1-6356-467e-8a9e-e81012b25879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f6e7d1-6356-467e-8a9e-e81012b25879', 'volume_size': 1} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Created reservations ['5968b572-3e4a-4fda-8984-8f3721d1a837', 'cb618157-6a3a-4396-b084-bf4f8c1273da', '922a4664-c874-4ced-a42d-c0c42aa46dcf', '157594b7-2541-429c-abf9-675e3baade2e'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:26 devstack sudo[112270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:26 devstack sudo[112270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (cf2c2695-10d6-4dcb-a2ea-1568f1643972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c434b4a-5eb2-4bcc-a273-fa5d43fe88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-5c67f2bb-480c-478d-8a58-91d32d9ed695-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c434b4a-5eb2-4bcc-a273-fa5d43fe88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1301883426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dc9264-5266-4ed8-b704-561911216814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:26Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32b4970-ae3e-433f-a484-b29130e7be5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f32b4970-ae3e-433f-a484-b29130e7be5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1750d2da-f512-4e58-833e-43115db5a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1750d2da-f512-4e58-833e-43115db5a56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25dc9264-5266-4ed8-b704-561911216814', 'volume_name': 'volume-25dc9264-5266-4ed8-b704-561911216814', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5914decb-64ba-4878-b83d-6a5571eacc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5914decb-64ba-4878-b83d-6a5571eacc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ede0159-7002-47cc-a065-400650755f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:26 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume 25dc9264-5266-4ed8-b704-561911216814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25dc9264-5266-4ed8-b704-561911216814', 'volume_size': 1} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-5c67f2bb-480c-478d-8a58-91d32d9ed695-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "cinder-quobyte-5c67f2bb-480c-478d-8a58-91d32d9ed695" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-5c67f2bb-480c-478d-8a58-91d32d9ed695" acquired by "delete_volume" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b97bdf7-a4c0-4e88-9787-7d01fc3d7880]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:26 devstack sudo[112275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 Jun 23 14:15:26 devstack sudo[112275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:26 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f 1073741824" returned: 0 in 1.367s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (ad1296fe-ae6b-431c-8a32-8718c3d7bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509f384d-3f98-42e0-b8c5-5b51021fe015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (509f384d-3f98-42e0-b8c5-5b51021fe015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910856585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8df6a9-5b46-4f14-affa-1dc453bbd020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:27Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bedb27-792e-4f4f-af2b-3dcbe8be3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack sudo[112279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bedb27-792e-4f4f-af2b-3dcbe8be3603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack sudo[112279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874e661d-21f0-4286-97ad-62aaad0386d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874e661d-21f0-4286-97ad-62aaad0386d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8df6a9-5b46-4f14-affa-1dc453bbd020', 'volume_name': 'volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d471ddbc-bb4e-4e3b-87f2-5b44c537d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d471ddbc-bb4e-4e3b-87f2-5b44c537d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d35a69-0619-4b2f-8ecf-dcdebb288407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume 0b8df6a9-5b46-4f14-affa-1dc453bbd020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020', 'volume_size': 1} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:27 devstack sudo[112270]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.245s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Deleted volume successfully. Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-196cbf82-7919-4274-8377-64a326188c5c tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-12a1fbc4-0865-49f9-9a36-8b576196305e-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (11639f1a-3859-4b22-9134-a1d395fe60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6c8f7f-9b43-48a8-8f21-fa584ce20164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6c8f7f-9b43-48a8-8f21-fa584ce20164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977117505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c8ae1a-b704-4c72-ab4c-ba1754da5fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:27Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf106a7-885c-42fe-aafe-68afc325420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf106a7-885c-42fe-aafe-68afc325420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019ab6a8-8c7b-4723-9345-3de5c2e8027d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019ab6a8-8c7b-4723-9345-3de5c2e8027d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c8ae1a-b704-4c72-ab4c-ba1754da5fc5', 'volume_name': 'volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509d3709-4d5e-4619-873f-be65917184c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509d3709-4d5e-4619-873f-be65917184c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7470b9a9-b195-423c-8622-a7655df69670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume 92c8ae1a-b704-4c72-ab4c-ba1754da5fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5', 'volume_size': 1} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:27 devstack sudo[112275]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695" returned: 0 in 1.086s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:27 devstack sudo[112284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695 Jun 23 14:15:27 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:27 devstack sudo[112279]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f" returned: 0 in 0.801s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-921613442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f6e7d1-6356-467e-8a9e-e81012b25879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:26Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating volume 06f6e7d1-6356-467e-8a9e-e81012b25879 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:27 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:27 devstack sudo[112287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 1073741824 Jun 23 14:15:27 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e772d9b1-116a-4ef9-85ab-524a2863200e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09ef5a9-9234-4f2b-8586-86cf41faf846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:27 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f (eea30ea7-e06d-473d-8acf-62b1c93a8a3f): created successfully Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09ef5a9-9234-4f2b-8586-86cf41faf846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (0744cc48-08f2-4770-b82d-befc0352fa83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-47f2171c-1825-478f-afba-d1d3c3dcc0ad tempest-CreateVolumesFromSnapshotTest-598247247 None] Created volume successfully. Jun 23 14:15:28 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5c67f2bb-480c-478d-8a58-91d32d9ed695" returned: 0 in 0.661s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-quobyte-5c67f2bb-480c-478d-8a58-91d32d9ed695" released by "delete_volume" :: held 1.803s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Created reservations ['4925610c-a5dc-4f50-b0c9-6bcee9c664bb', '32555151-5a11-4a9f-b749-5829c6f91230', '39b4ca69-5e13-46b3-906d-2ac619beaaed', 'fb81eaf4-1bc7-4d45-acab-5fce9e83f8ac'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:28 devstack sudo[112290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:28 devstack sudo[112290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:28 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 1073741824" returned: 0 in 1.030s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:28 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 Jun 23 14:15:28 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:29 devstack sudo[112290]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.777s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Deleted volume successfully. Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c168337-5b2e-4f74-b594-d9f96a720de2 tempest-CreateVolumesFromImageTest-1594856443 None] Lock "cinder-5c67f2bb-480c-478d-8a58-91d32d9ed695-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:29 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879" returned: 0 in 0.794s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.379s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1301883426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dc9264-5266-4ed8-b704-561911216814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:26Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating volume 25dc9264-5266-4ed8-b704-561911216814 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:29 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:29 devstack sudo[112300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 1073741824 Jun 23 14:15:29 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52ba80b-266d-479f-b593-a9771a60660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f6e7d1-6356-467e-8a9e-e81012b25879', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8761855-88ed-452f-a44b-d59a31997334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:29 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume volume-06f6e7d1-6356-467e-8a9e-e81012b25879 (06f6e7d1-6356-467e-8a9e-e81012b25879): created successfully Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8761855-88ed-452f-a44b-d59a31997334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (2e71cd70-9933-4b4e-824c-aa19c063f286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d8a030d3-c4b1-4de6-ab52-3e0717c48aab tempest-CreateVolumesFromSnapshotTest-598247247 None] Created volume successfully. Jun 23 14:15:30 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 1073741824" returned: 0 in 1.077s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:30 devstack sudo[112308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 Jun 23 14:15:30 devstack sudo[112308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:31 devstack sudo[112308]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814" returned: 0 in 0.717s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.466s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910856585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8df6a9-5b46-4f14-affa-1dc453bbd020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:27Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating volume 0b8df6a9-5b46-4f14-affa-1dc453bbd020 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:31 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:31 devstack sudo[112311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 1073741824 Jun 23 14:15:31 devstack sudo[112311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ede0159-7002-47cc-a065-400650755f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dc9264-5266-4ed8-b704-561911216814', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a6cb13-a948-4939-819c-9fe074e8b57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume volume-25dc9264-5266-4ed8-b704-561911216814 (25dc9264-5266-4ed8-b704-561911216814): created successfully Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a6cb13-a948-4939-819c-9fe074e8b57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (cf2c2695-10d6-4dcb-a2ea-1568f1643972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2bc8068a-92ad-45b6-a445-62ec01db5f21 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created volume successfully. Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (afd3becb-bc81-48b4-9928-3682fe9dc5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956b0443-9923-4de4-b7c2-63f7d647486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956b0443-9923-4de4-b7c2-63f7d647486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864553494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90c7c9f-0613-4b17-80bf-d5c23ede0428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:32Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c7b17-3318-498e-a402-b19ca1edc34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c7b17-3318-498e-a402-b19ca1edc34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435cc084-c55c-42d5-83dc-ad8cc44889e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435cc084-c55c-42d5-83dc-ad8cc44889e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90c7c9f-0613-4b17-80bf-d5c23ede0428', 'volume_name': 'volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b67796-2bab-4eeb-b8e0-d0276b5cfaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b67796-2bab-4eeb-b8e0-d0276b5cfaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4968033c-3995-4f5a-81fb-c076040c5b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:32 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume c90c7c9f-0613-4b17-80bf-d5c23ede0428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428', 'volume_size': 1} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:32 devstack sudo[112311]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 1073741824" returned: 0 in 0.894s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:32 devstack sudo[112317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 Jun 23 14:15:32 devstack sudo[112317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:33 devstack sudo[112317]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020" returned: 0 in 0.652s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.710s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1977117505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c8ae1a-b704-4c72-ab4c-ba1754da5fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50182fef292c427e8306396732572de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:27Z,use_quota=True,user_id='b4602e8e57b340abbc2b6236037a9f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Creating volume 92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:33 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d35a69-0619-4b2f-8ecf-dcdebb288407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:33 devstack sudo[112320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 1073741824 Jun 23 14:15:33 devstack sudo[112320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c231c95-db09-48df-a5a7-3820b0e01aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:33 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 (0b8df6a9-5b46-4f14-affa-1dc453bbd020): created successfully Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c231c95-db09-48df-a5a7-3820b0e01aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (ad1296fe-ae6b-431c-8a32-8718c3d7bee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d288c37f-661c-4291-ac1c-01dde9fee831 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created volume successfully. Jun 23 14:15:34 devstack sudo[112320]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 1073741824" returned: 0 in 0.847s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:34 devstack sudo[112328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 Jun 23 14:15:34 devstack sudo[112328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:34 devstack sudo[112328]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5" returned: 0 in 0.696s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864553494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90c7c9f-0613-4b17-80bf-d5c23ede0428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:32Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Creating volume c90c7c9f-0613-4b17-80bf-d5c23ede0428 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:34 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:34 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 1073741824 Jun 23 14:15:34 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7470b9a9-b195-423c-8622-a7655df69670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ec003a-5da2-45c5-979f-0c00c29771c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:34 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Volume volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 (92c8ae1a-b704-4c72-ab4c-ba1754da5fc5): created successfully Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ec003a-5da2-45c5-979f-0c00c29771c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:34 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Flow 'volume_create_manager' (11639f1a-3859-4b22-9134-a1d395fe60e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:34 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-76955290-5915-492c-817f-44addb3a0f95 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created volume successfully. Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4847f7e-03ed-4ab3-a2e1-31811c72133e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:35 devstack sudo[112333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 Jun 23 14:15:35 devstack sudo[112333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:35 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 1073741824" returned: 0 in 0.911s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:35 devstack sudo[112338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 Jun 23 14:15:35 devstack sudo[112338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:36 devstack sudo[112333]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5" returned: 0 in 0.844s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:36 devstack sudo[112343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5 Jun 23 14:15:36 devstack sudo[112343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:36 devstack sudo[112338]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428" returned: 0 in 0.699s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4968033c-3995-4f5a-81fb-c076040c5b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872bd12d-7e3a-4518-9e17-af2bbebfd97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:36 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 (c90c7c9f-0613-4b17-80bf-d5c23ede0428): created successfully Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872bd12d-7e3a-4518-9e17-af2bbebfd97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (afd3becb-bc81-48b4-9928-3682fe9dc5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:36 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a51e2ddd-c6c9-4897-8aca-7a94cd4af993 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created volume successfully. Jun 23 14:15:36 devstack sudo[112343]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5" returned: 0 in 0.683s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5" released by "delete_volume" :: held 1.576s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['c2d05754-d838-4b58-9673-bbe2e06a2ba0', 'a7fc3bb0-f750-4e33-8670-4a7dfd5fa0cf', '019840e6-a248-419c-8c8d-4b437c448c39', 'e82b44b3-66e9-4c32-aacd-fa433f5f18da'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:37 devstack sudo[112347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:37 devstack sudo[112347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-0b8df6a9-5b46-4f14-affa-1dc453bbd020-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-0b8df6a9-5b46-4f14-affa-1dc453bbd020-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-0b8df6a9-5b46-4f14-affa-1dc453bbd020" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-0b8df6a9-5b46-4f14-affa-1dc453bbd020" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16e5fb-a056-40db-9ddc-89d149decf66]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:37 devstack sudo[112347]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.840s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:37 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleted volume successfully. Jun 23 14:15:37 devstack sudo[112349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 Jun 23 14:15:37 devstack sudo[112349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-59f6cdd7-abe2-47a4-96f8-325690c8f5d2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-92c8ae1a-b704-4c72-ab4c-ba1754da5fc5-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:37 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (ced305bc-7db6-494d-bca3-0ac304c05bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790385bd-4dd0-4bae-a751-b6f16334a712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790385bd-4dd0-4bae-a751-b6f16334a712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551009641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35d6c02-528d-4b70-9fdb-b3e127fdc028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:38Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81ee532-800d-49f7-a6aa-2c5cdd40ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81ee532-800d-49f7-a6aa-2c5cdd40ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6db47b-d42d-4155-8776-b4b6ae5cae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6db47b-d42d-4155-8776-b4b6ae5cae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35d6c02-528d-4b70-9fdb-b3e127fdc028', 'volume_name': 'volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6b479a-8a8a-4b59-b9be-4947c1d44f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6b479a-8a8a-4b59-b9be-4947c1d44f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794f658-e341-4140-9825-9eb8f3a5e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume a35d6c02-528d-4b70-9fdb-b3e127fdc028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028', 'volume_size': 1} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-551009641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35d6c02-528d-4b70-9fdb-b3e127fdc028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:38Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Creating volume a35d6c02-528d-4b70-9fdb-b3e127fdc028 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:38 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:38 devstack sudo[112352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 1073741824 Jun 23 14:15:38 devstack sudo[112352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (67b4deb8-d113-47a5-9a92-04d2d4ced676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1beb880-225f-4205-932e-07dd373607cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1beb880-225f-4205-932e-07dd373607cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-124356877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c8402a-f321-4672-920e-ae98c4d65f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:38Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a917a-aa57-427b-9891-b5a81c6cdd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408a917a-aa57-427b-9891-b5a81c6cdd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4573ef0-c65f-4693-8607-cdd127da2dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4573ef0-c65f-4693-8607-cdd127da2dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c8402a-f321-4672-920e-ae98c4d65f70', 'volume_name': 'volume-63c8402a-f321-4672-920e-ae98c4d65f70', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d553ec3c-3e8d-41b1-aa99-550dfc5efd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d553ec3c-3e8d-41b1-aa99-550dfc5efd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd7dd9d-801f-4038-9a20-b1ec663ce4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume 63c8402a-f321-4672-920e-ae98c4d65f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c8402a-f321-4672-920e-ae98c4d65f70', 'volume_size': 1} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:38 devstack sudo[112349]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (35c47731-51c6-4900-b99a-8763dc3942dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9422f3d3-4fc0-4ccf-b235-aa9789bd9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020" returned: 0 in 1.273s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9422f3d3-4fc0-4ccf-b235-aa9789bd9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-469525598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a84497-4116-4262-8afe-cb05cddb3ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:39Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c95fbab-6e5a-452d-9952-f535287c380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack sudo[112360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020 Jun 23 14:15:38 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c95fbab-6e5a-452d-9952-f535287c380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab23969a-5efd-4be7-a549-f524773f522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab23969a-5efd-4be7-a549-f524773f522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a84497-4116-4262-8afe-cb05cddb3ab2', 'volume_name': 'volume-62a84497-4116-4262-8afe-cb05cddb3ab2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64b6ace-52ea-440f-bbcc-66e6feaf2ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64b6ace-52ea-440f-bbcc-66e6feaf2ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a481927d-d4a4-4c04-ae82-b5ab519a347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume 62a84497-4116-4262-8afe-cb05cddb3ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a84497-4116-4262-8afe-cb05cddb3ab2', 'volume_size': 1} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:39 devstack sudo[112352]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 1073741824" returned: 0 in 1.169s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (fe6a5641-47b9-40ea-ae20-8b9aec20878b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba8821c-5487-4242-9335-4c060eda4ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba8821c-5487-4242-9335-4c060eda4ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2047756433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb132b5-624a-4891-b28b-46539daa3b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:39Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbde7846-251d-47b8-8256-b466580a29d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 Jun 23 14:15:39 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbde7846-251d-47b8-8256-b466580a29d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29868cfa-ba98-467d-8159-3aa2fc946cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29868cfa-ba98-467d-8159-3aa2fc946cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb132b5-624a-4891-b28b-46539daa3b7d', 'volume_name': 'volume-6bb132b5-624a-4891-b28b-46539daa3b7d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b81ad3b-f945-40d8-9403-8176caf3980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b81ad3b-f945-40d8-9403-8176caf3980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6919a1c-a874-4d7b-9380-61757da40f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume 6bb132b5-624a-4891-b28b-46539daa3b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb132b5-624a-4891-b28b-46539daa3b7d', 'volume_size': 1} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:39 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0b8df6a9-5b46-4f14-affa-1dc453bbd020" returned: 0 in 0.904s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-0b8df6a9-5b46-4f14-affa-1dc453bbd020" released by "delete_volume" :: held 2.240s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (9a4d5ea2-5b18-4953-a52c-e7f1aec400ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c6da54-f2df-4281-af58-2df7fe919480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['372fc522-4a24-4813-bba5-4bf9f6104d37', 'db670aab-c029-49cd-a73f-4b1e25cf28e1', '19ee34dd-670a-4bad-9dab-2b7d5be191c7', '123fc082-f6df-4184-af5f-1adeb47ea3cb'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c6da54-f2df-4281-af58-2df7fe919480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764380767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600f2a82-3a2f-4698-b64e-7d1df83ec73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:40Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:39 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5987b845-3b31-4782-ad0a-edaac67d4d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5987b845-3b31-4782-ad0a-edaac67d4d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed7a1a9-d6f2-4191-ac5a-a32eae9a2321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed7a1a9-d6f2-4191-ac5a-a32eae9a2321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600f2a82-3a2f-4698-b64e-7d1df83ec73a', 'volume_name': 'volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ef9804-da5b-4338-9d2b-ce92a9203187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ef9804-da5b-4338-9d2b-ce92a9203187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201d9c5e-f76f-4f67-a68e-00e77bd9b424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:40 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume 600f2a82-3a2f-4698-b64e-7d1df83ec73a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a', 'volume_size': 1} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:40 devstack sudo[112367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:40 devstack sudo[112367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:40 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028" returned: 0 in 0.782s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.667s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-124356877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c8402a-f321-4672-920e-ae98c4d65f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:38Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Creating volume 63c8402a-f321-4672-920e-ae98c4d65f70 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:40 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:40 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 1073741824 Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a794f658-e341-4140-9825-9eb8f3a5e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:40 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643ee40b-609f-407c-8954-3eadead0b315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:40 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 (a35d6c02-528d-4b70-9fdb-b3e127fdc028): created successfully Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643ee40b-609f-407c-8954-3eadead0b315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (ced305bc-7db6-494d-bca3-0ac304c05bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4b262fe4-8198-4dff-9ade-2dd87743f1d1 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created volume successfully. Jun 23 14:15:40 devstack sudo[112367]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.700s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleted volume successfully. Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=93,cinder:INSERT=33,cinder:UPDATE=129,cinder:DELETE=9 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-387f8e23-1002-4761-b3a2-6c4345e9b20a tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-0b8df6a9-5b46-4f14-affa-1dc453bbd020-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-25dc9264-5266-4ed8-b704-561911216814-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-25dc9264-5266-4ed8-b704-561911216814-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-25dc9264-5266-4ed8-b704-561911216814" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-25dc9264-5266-4ed8-b704-561911216814" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d446d2a9-29e4-450b-8045-18eb00f1b539]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:41 devstack sudo[112376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 Jun 23 14:15:41 devstack sudo[112376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:41 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 1073741824" returned: 0 in 1.032s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:41 devstack sudo[112378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 Jun 23 14:15:41 devstack sudo[112378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:41 devstack sudo[112376]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814" returned: 0 in 0.808s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:41 devstack sudo[112383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814 Jun 23 14:15:41 devstack sudo[112383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:42 devstack sudo[112378]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70" returned: 0 in 0.750s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.031s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-469525598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a84497-4116-4262-8afe-cb05cddb3ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:39Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Creating volume 62a84497-4116-4262-8afe-cb05cddb3ab2 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:42 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:42 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 1073741824 Jun 23 14:15:42 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd7dd9d-801f-4038-9a20-b1ec663ce4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c8402a-f321-4672-920e-ae98c4d65f70', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8facb5ab-83b6-4b30-9ef1-d971ae6f291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:42 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume volume-63c8402a-f321-4672-920e-ae98c4d65f70 (63c8402a-f321-4672-920e-ae98c4d65f70): created successfully Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8facb5ab-83b6-4b30-9ef1-d971ae6f291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (67b4deb8-d113-47a5-9a92-04d2d4ced676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:42 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-52450296-6fda-4763-aaa0-3c125604e3d7 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created volume successfully. Jun 23 14:15:42 devstack sudo[112383]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-25dc9264-5266-4ed8-b704-561911216814" returned: 0 in 0.733s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-25dc9264-5266-4ed8-b704-561911216814" released by "delete_volume" :: held 1.588s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['318ecda2-c2d8-407c-9240-500bd025a8a0', 'd787f2f1-8980-4e23-959f-c12766e9a159', '6548f83e-970c-4474-9e34-27cec5ae2c24', 'dcc6957f-420b-4d6a-8731-099bb039eea6'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:42 devstack sudo[112393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:42 devstack sudo[112393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:42 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 1073741824" returned: 0 in 0.917s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:43 devstack sudo[112395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 Jun 23 14:15:43 devstack sudo[112395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-06f6e7d1-6356-467e-8a9e-e81012b25879-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-06f6e7d1-6356-467e-8a9e-e81012b25879-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-06f6e7d1-6356-467e-8a9e-e81012b25879" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-06f6e7d1-6356-467e-8a9e-e81012b25879" acquired by "delete_volume" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f954775-66df-428d-a996-2d5cdb43ab1d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:43 devstack sudo[112397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 Jun 23 14:15:43 devstack sudo[112397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:43 devstack sudo[112393]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.729s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleted volume successfully. Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d02d3af9-3903-4990-acdb-1522524bf6e3 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-25dc9264-5266-4ed8-b704-561911216814-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:43 devstack sudo[112395]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2" returned: 0 in 0.725s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.214s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2047756433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb132b5-624a-4891-b28b-46539daa3b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:39Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Creating volume 6bb132b5-624a-4891-b28b-46539daa3b7d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:43 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:43 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d 1073741824 Jun 23 14:15:43 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a481927d-d4a4-4c04-ae82-b5ab519a347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a84497-4116-4262-8afe-cb05cddb3ab2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bf7b97-450a-4440-812e-73055c7985fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:43 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume volume-62a84497-4116-4262-8afe-cb05cddb3ab2 (62a84497-4116-4262-8afe-cb05cddb3ab2): created successfully Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bf7b97-450a-4440-812e-73055c7985fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:43 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (35c47731-51c6-4900-b99a-8763dc3942dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-164d621a-c060-4071-b5bd-0b0fd7c8cc50 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created volume successfully. Jun 23 14:15:44 devstack sudo[112397]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879" returned: 0 in 0.915s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:44 devstack sudo[112443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879 Jun 23 14:15:44 devstack sudo[112443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:44 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d 1073741824" returned: 0 in 0.965s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:44 devstack sudo[112448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d Jun 23 14:15:44 devstack sudo[112448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:44 devstack sudo[112443]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-06f6e7d1-6356-467e-8a9e-e81012b25879" returned: 0 in 0.698s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-06f6e7d1-6356-467e-8a9e-e81012b25879" released by "delete_volume" :: held 1.655s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['c033f8af-5a1f-42fd-b337-b342bb5a7ddd', 'a0841cd9-ed97-41d6-8b52-67b4a89e5986', '8b379568-73ea-416a-a903-0c1e29f4da21', 'a42419ee-bfee-468c-907f-8c9d375caa3a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:45 devstack sudo[112451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:45 devstack sudo[112451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-eea30ea7-e06d-473d-8acf-62b1c93a8a3f-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:45 devstack sudo[112448]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d" returned: 0 in 0.765s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-eea30ea7-e06d-473d-8acf-62b1c93a8a3f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.507s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1764380767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600f2a82-3a2f-4698-b64e-7d1df83ec73a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e8bbf6a8f214506b2a6199e1ee6d97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:40Z,use_quota=True,user_id='4e1a0a95a2bc4849ba26c563b313b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Creating volume 600f2a82-3a2f-4698-b64e-7d1df83ec73a {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:45 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:45 devstack sudo[112454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a 1073741824 Jun 23 14:15:45 devstack sudo[112454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6919a1c-a874-4d7b-9380-61757da40f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb132b5-624a-4891-b28b-46539daa3b7d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3919f6d-e83a-41ab-9114-5679da80d5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:45 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume volume-6bb132b5-624a-4891-b28b-46539daa3b7d (6bb132b5-624a-4891-b28b-46539daa3b7d): created successfully Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3919f6d-e83a-41ab-9114-5679da80d5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (fe6a5641-47b9-40ea-ae20-8b9aec20878b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:45 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4ea4af38-17eb-46f9-b04b-edac04f778c0 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created volume successfully. Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-eea30ea7-e06d-473d-8acf-62b1c93a8a3f" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-eea30ea7-e06d-473d-8acf-62b1c93a8a3f" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9d6708-c438-4ea4-9ea3-04b511bf21cf]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:45 devstack sudo[112451]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.696s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:45 devstack sudo[112456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f Jun 23 14:15:45 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleted volume successfully. Jun 23 14:15:45 devstack sudo[112456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-580dc3d5-ff13-4390-82b5-3d7ebf06266f tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-06f6e7d1-6356-467e-8a9e-e81012b25879-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:46 devstack sudo[112454]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a 1073741824" returned: 0 in 0.939s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:46 devstack sudo[112466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a Jun 23 14:15:46 devstack sudo[112466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:46 devstack sudo[112456]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f" returned: 0 in 0.885s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:46 devstack sudo[112468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f Jun 23 14:15:46 devstack sudo[112468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:47 devstack sudo[112466]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a" returned: 0 in 0.681s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201d9c5e-f76f-4f67-a68e-00e77bd9b424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae31ac5-aa35-4f13-a769-166e19956bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:47 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Volume volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a (600f2a82-3a2f-4698-b64e-7d1df83ec73a): created successfully Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae31ac5-aa35-4f13-a769-166e19956bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Flow 'volume_create_manager' (9a4d5ea2-5b18-4953-a52c-e7f1aec400ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:47 devstack sudo[112468]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-eea30ea7-e06d-473d-8acf-62b1c93a8a3f" returned: 0 in 0.676s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-eea30ea7-e06d-473d-8acf-62b1c93a8a3f" released by "delete_volume" :: held 1.612s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-40763f07-798d-4c9a-8346-4ea034f1e633 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created volume successfully. Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['9aa5fd3e-f50d-4581-bb4a-de9050ed7496', 'd8604326-abd2-4455-91a4-7094c9b9c37f', '5bde1495-7533-406a-9d56-7c798381605c', '4ac40c5e-5dc2-4f83-b4d1-d467f6b27a80'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:47 devstack sudo[112472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:47 devstack sudo[112472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-600f2a82-3a2f-4698-b64e-7d1df83ec73a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-600f2a82-3a2f-4698-b64e-7d1df83ec73a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-quobyte-600f2a82-3a2f-4698-b64e-7d1df83ec73a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-600f2a82-3a2f-4698-b64e-7d1df83ec73a" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b679e8cc-40f3-4d7b-9497-d627cdff1441]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-ee804cd1-d8cb-4363-82bf-7b3598f0bb04-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-ee804cd1-d8cb-4363-82bf-7b3598f0bb04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-50677b4e-d9b6-4ffa-8e59-af4feace9b96" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-50677b4e-d9b6-4ffa-8e59-af4feace9b96" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-ee804cd1-d8cb-4363-82bf-7b3598f0bb04" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-ee804cd1-d8cb-4363-82bf-7b3598f0bb04" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleting offline snapshot ee804cd1-d8cb-4363-82bf-7b3598f0bb04 of volume 50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:15:47 devstack sudo[112474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a Jun 23 14:15:47 devstack sudo[112474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] snapshot_file for this snap is: volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1499f901-253c-4311-97fe-0adc7986e6c0]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:48 devstack sudo[112476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 Jun 23 14:15:48 devstack sudo[112476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:48 devstack sudo[112472]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.778s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleted volume successfully. Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3f0b028-3e0f-47ff-acaa-ee5c19e79fd2 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-eea30ea7-e06d-473d-8acf-62b1c93a8a3f-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:48 devstack sudo[112474]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a" returned: 0 in 0.880s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:48 devstack sudo[112486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a Jun 23 14:15:48 devstack sudo[112486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:48 devstack sudo[112476]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04" returned: 0 in 0.899s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da43a9-6e21-403e-9067-87ec7b78e4d2]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:48 devstack sudo[112489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 Jun 23 14:15:48 devstack sudo[112489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:49 devstack sudo[112486]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-600f2a82-3a2f-4698-b64e-7d1df83ec73a" returned: 0 in 0.685s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-600f2a82-3a2f-4698-b64e-7d1df83ec73a" released by "delete_volume" :: held 1.638s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created reservations ['e8ac0881-8063-46f9-add2-8ddc9890ad83', 'd7facb68-dd27-41fe-a9b4-f53c9e51d937', 'ba5dbc46-0234-44eb-a328-72eb750e097a', '8b92bffd-684d-43d7-9e6e-952be6e52251'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:49 devstack sudo[112492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:49 devstack sudo[112492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:49 devstack sudo[112489]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:49 devstack sudo[112497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 Jun 23 14:15:49 devstack sudo[112497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-6bb132b5-624a-4891-b28b-46539daa3b7d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-6bb132b5-624a-4891-b28b-46539daa3b7d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-quobyte-6bb132b5-624a-4891-b28b-46539daa3b7d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-6bb132b5-624a-4891-b28b-46539daa3b7d" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fed353-d393-4412-aebd-f882c10a54e7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:50 devstack sudo[112499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d Jun 23 14:15:50 devstack sudo[112499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:50 devstack sudo[112492]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.730s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:50 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Deleted volume successfully. Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d45ed3c8-1112-4430-ae2a-d55f4500dcbc tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-600f2a82-3a2f-4698-b64e-7d1df83ec73a-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:50 devstack sudo[112497]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04" returned: 0 in 0.804s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:50 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04 Jun 23 14:15:50 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:50 devstack sudo[112499]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d" returned: 0 in 0.818s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:50 devstack sudo[112510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d Jun 23 14:15:50 devstack sudo[112510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:51 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96.ee804cd1-d8cb-4363-82bf-7b3598f0bb04" returned: 0 in 0.707s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-ee804cd1-d8cb-4363-82bf-7b3598f0bb04" released by "_delete_snapshot" :: held 3.359s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-50677b4e-d9b6-4ffa-8e59-af4feace9b96" released by "delete_snapshot" :: held 3.389s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['a1f1bc56-4282-4dfd-9639-736ec3652166', '5de77ce5-dd49-4f96-89a9-32c4552ad46e', 'df317620-1eb8-40cc-90df-aacda4fc0cd8', '90bc0883-7d19-4fda-9245-a2129a83c458'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Delete snapshot completed successfully. Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-d2db3aae-2365-466a-adf1-3e8c0bc58b50 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-ee804cd1-d8cb-4363-82bf-7b3598f0bb04-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:51 devstack sudo[112510]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6bb132b5-624a-4891-b28b-46539daa3b7d" returned: 0 in 0.729s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-6bb132b5-624a-4891-b28b-46539daa3b7d" released by "delete_volume" :: held 1.588s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created reservations ['aa99f378-4914-4033-af73-cd1a63c9d03c', 'e36ebefa-6992-4325-98e6-0765f4dd261e', 'e59a222d-e06b-4cd5-be57-e9b2248fb5cf', '470007d8-fd5c-45e3-9d7e-036740ee6775'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:51 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:51 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:51 devstack sudo[112516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:51 devstack sudo[112516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-50677b4e-d9b6-4ffa-8e59-af4feace9b96-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-50677b4e-d9b6-4ffa-8e59-af4feace9b96-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "cinder-quobyte-50677b4e-d9b6-4ffa-8e59-af4feace9b96" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-50677b4e-d9b6-4ffa-8e59-af4feace9b96" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-62a84497-4116-4262-8afe-cb05cddb3ab2-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4879634-404a-46a5-9e62-5f55c3249bbe]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-62a84497-4116-4262-8afe-cb05cddb3ab2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-quobyte-62a84497-4116-4262-8afe-cb05cddb3ab2" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-62a84497-4116-4262-8afe-cb05cddb3ab2" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e395f75f-c44f-4dfa-99da-ef7305f1e78a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:52 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.816s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:52 devstack sudo[112519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:15:52 devstack sudo[112519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:15:52 devstack sudo[112520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 Jun 23 14:15:52 devstack sudo[112520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:52 devstack sudo[112516]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.879s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Deleted volume successfully. Jun 23 14:15:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-eea727c6-3904-4fd0-a1bb-9a356a232183 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-6bb132b5-624a-4891-b28b-46539daa3b7d-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:53 devstack sudo[112519]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96" returned: 0 in 0.922s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:53 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96 Jun 23 14:15:53 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:53 devstack sudo[112520]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2" returned: 0 in 0.889s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:53 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2 Jun 23 14:15:53 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:53 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-50677b4e-d9b6-4ffa-8e59-af4feace9b96" returned: 0 in 0.682s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-quobyte-50677b4e-d9b6-4ffa-8e59-af4feace9b96" released by "delete_volume" :: held 1.711s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Created reservations ['b86829bc-e4e8-4aeb-9b07-0b147edd3ab8', 'dca94ba9-fb95-4b83-bf2b-280beb4460a2', '57501caf-c35e-4425-b956-707d4ff1b55d', '83beb7d5-73d2-4fb5-ac8b-4c66af778b68'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:54 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-62a84497-4116-4262-8afe-cb05cddb3ab2" returned: 0 in 0.687s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-62a84497-4116-4262-8afe-cb05cddb3ab2" released by "delete_volume" :: held 1.636s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:54 devstack sudo[112538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:54 devstack sudo[112538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created reservations ['6404cef7-aabd-4c3b-899c-a1c3b61eee27', 'ca211899-3d64-4a51-a641-83e4f1a3ba9b', '84ce6cd3-a6d7-4b77-9548-4426e1fddbf1', 'fcf737dd-e75f-43e8-8b3c-b7bc67769d64'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:54 devstack sudo[112540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:54 devstack sudo[112540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-63c8402a-f321-4672-920e-ae98c4d65f70-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-63c8402a-f321-4672-920e-ae98c4d65f70-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-quobyte-63c8402a-f321-4672-920e-ae98c4d65f70" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-63c8402a-f321-4672-920e-ae98c4d65f70" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[facbfa9a-96af-4049-8297-ec3a2ee0dc08]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:54 devstack sudo[112538]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.807s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Deleted volume successfully. Jun 23 14:15:54 devstack sudo[112543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 Jun 23 14:15:54 devstack sudo[112543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-756cca72-b53f-4581-9062-bfcea5aed803 tempest-CreateVolumesFromSnapshotTest-598247247 None] Lock "cinder-50677b4e-d9b6-4ffa-8e59-af4feace9b96-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:55 devstack sudo[112540]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.762s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:55 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:55 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Deleted volume successfully. Jun 23 14:15:55 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2b62a729-9c71-47d3-a46a-fe007e1e9b86 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-62a84497-4116-4262-8afe-cb05cddb3ab2-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:55 devstack sudo[112543]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70" returned: 0 in 0.954s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:55 devstack sudo[112550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70 Jun 23 14:15:55 devstack sudo[112550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:56 devstack sudo[112550]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-63c8402a-f321-4672-920e-ae98c4d65f70" returned: 0 in 0.748s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-63c8402a-f321-4672-920e-ae98c4d65f70" released by "delete_volume" :: held 1.761s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created reservations ['b1d7e01b-3f28-4e6b-bb8c-5f5b69a992a4', '073f9a86-7e58-4c3e-871e-06ba0d73f2d9', '1ea00502-a088-412a-a051-1a2301568c96', 'a55d1bd0-9e39-4d77-bba9-081a025e6462'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:56 devstack sudo[112553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:56 devstack sudo[112553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-a35d6c02-528d-4b70-9fdb-b3e127fdc028-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-a35d6c02-528d-4b70-9fdb-b3e127fdc028-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-quobyte-a35d6c02-528d-4b70-9fdb-b3e127fdc028" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-a35d6c02-528d-4b70-9fdb-b3e127fdc028" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c59f4-6e9a-4501-8cf3-cc96f31c5118]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:57 devstack sudo[112555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 Jun 23 14:15:57 devstack sudo[112555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:57 devstack sudo[112553]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.755s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Deleted volume successfully. Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c3af1979-77af-4aca-a54b-d4b495775c93 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-63c8402a-f321-4672-920e-ae98c4d65f70-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:57 devstack sudo[112555]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028" returned: 0 in 0.868s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:57 devstack sudo[112561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028 Jun 23 14:15:57 devstack sudo[112561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Flow 'volume_create_manager' (3ab23a17-517f-41db-979f-ead88933a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05fdfff-c015-4843-8b66-ba2da934afe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05fdfff-c015-4843-8b66-ba2da934afe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-101007027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc273673-e040-4b66-a7fc-11b0fd982281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586d149bbf4d3aba3cb5173c5e762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:58Z,use_quota=True,user_id='d58c78b4afe34d838d494f57aa978377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9008668-1f9d-48b2-9c04-ddafdefc1825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9008668-1f9d-48b2-9c04-ddafdefc1825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc8ff35-8907-4826-94b0-d2e07958a238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc8ff35-8907-4826-94b0-d2e07958a238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc273673-e040-4b66-a7fc-11b0fd982281', 'volume_name': 'volume-fc273673-e040-4b66-a7fc-11b0fd982281', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b2de74-a5c2-4ea8-9406-585f2180cc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b2de74-a5c2-4ea8-9406-585f2180cc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d55eda4-b3f6-49df-9cd2-b9dcdeb81092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:58 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Volume fc273673-e040-4b66-a7fc-11b0fd982281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc273673-e040-4b66-a7fc-11b0fd982281', 'volume_size': 1} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-101007027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc273673-e040-4b66-a7fc-11b0fd982281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586d149bbf4d3aba3cb5173c5e762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:15:58Z,use_quota=True,user_id='d58c78b4afe34d838d494f57aa978377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Creating volume fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:15:58 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:58 devstack sudo[112563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 1073741824 Jun 23 14:15:58 devstack sudo[112563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:58 devstack sudo[112561]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a35d6c02-528d-4b70-9fdb-b3e127fdc028" returned: 0 in 0.697s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-a35d6c02-528d-4b70-9fdb-b3e127fdc028" released by "delete_volume" :: held 1.615s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created reservations ['088588b6-002b-4979-ac1a-ed5e3c90b1c6', '245bc4c1-c5bb-4fad-a955-7f7164b409f2', 'd8b53576-cf79-46ad-b888-558676368883', '05dc0eb3-e51b-460a-bc80-80da62b68385'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:58 devstack sudo[112569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:15:58 devstack sudo[112569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:58 devstack sudo[112563]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:58 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 1073741824" returned: 0 in 0.885s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:59 devstack sudo[112572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:15:59 devstack sudo[112572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-c90c7c9f-0613-4b17-80bf-d5c23ede0428-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-c90c7c9f-0613-4b17-80bf-d5c23ede0428-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "cinder-quobyte-c90c7c9f-0613-4b17-80bf-d5c23ede0428" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-c90c7c9f-0613-4b17-80bf-d5c23ede0428" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e34a00-2a02-41cd-bb3a-73562672fff9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:15:59 devstack sudo[112569]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:59 devstack sudo[112575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.705s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:59 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:15:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Deleted volume successfully. Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f056d2a6-8ba0-4861-9cb5-fe5963b38d4a tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-a35d6c02-528d-4b70-9fdb-b3e127fdc028-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:15:59 devstack sudo[112572]: pam_unix(sudo:session): session closed for user root Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 0.758s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d55eda4-b3f6-49df-9cd2-b9dcdeb81092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc273673-e040-4b66-a7fc-11b0fd982281', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9531b8a-11f6-4f58-8560-7e9abff7b425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:15:59 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Volume volume-fc273673-e040-4b66-a7fc-11b0fd982281 (fc273673-e040-4b66-a7fc-11b0fd982281): created successfully Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9531b8a-11f6-4f58-8560-7e9abff7b425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:15:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Flow 'volume_create_manager' (3ab23a17-517f-41db-979f-ead88933a497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:15:59 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-d5049403-3b0b-4ef6-82e6-82d2a01e433a tempest-VolumeDependencyTests-1919431740 None] Created volume successfully. Jun 23 14:16:00 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428" returned: 0 in 0.867s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:00 devstack sudo[112581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428 Jun 23 14:16:00 devstack sudo[112581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Creating offline snapshot 55aa66f7-0332-4869-b76c-e9719ecf4cc1 of volume fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb66f5-afe2-4adc-a991-8f9a65d6c3a6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:00 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:00 devstack sudo[112583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:16:00 devstack sudo[112583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:01 devstack sudo[112581]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c90c7c9f-0613-4b17-80bf-d5c23ede0428" returned: 0 in 0.835s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-quobyte-c90c7c9f-0613-4b17-80bf-d5c23ede0428" released by "delete_volume" :: held 1.751s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Created reservations ['b3a3fc34-ac23-4e15-b920-1b3b0f8f44fe', 'cfc6bf3e-128a-437f-b9e8-71750823c7a6', '9b7c0b7b-2129-4328-a4ec-0f7adba861c5', 'f024297b-3bc4-4cb3-ab5b-f6b3378f6c1a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:01 devstack sudo[112589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:01 devstack sudo[112589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:01 devstack sudo[112583]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 0.957s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:01 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:01 devstack sudo[112591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 1G Jun 23 14:16:01 devstack sudo[112591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:02 devstack sudo[112589]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.746s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:02 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:02 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Deleted volume successfully. Jun 23 14:16:02 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-2646188c-1991-4699-ac90-13e0c655e0f8 tempest-CreateVolumesFromSourceVolumeTest-937224203 None] Lock "cinder-c90c7c9f-0613-4b17-80bf-d5c23ede0428-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:02 devstack sudo[112591]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 1G" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc273673-e040-4b66-a7fc-11b0fd982281 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:02 devstack sudo[112598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc273673-e040-4b66-a7fc-11b0fd982281 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 Jun 23 14:16:02 devstack sudo[112598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:03 devstack sudo[112598]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc273673-e040-4b66-a7fc-11b0fd982281 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1" returned: 0 in 0.938s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:03 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 is being set with open permissions: ugo+rw Jun 23 14:16:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:03 devstack sudo[112603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 Jun 23 14:16:03 devstack sudo[112603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:04 devstack sudo[112603]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1" returned: 0 in 0.832s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:04 devstack sudo[112607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info Jun 23 14:16:04 devstack sudo[112607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:05 devstack sudo[112607]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info" returned: 0 in 0.797s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:05 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info is being set with open permissions: ugo+rw Jun 23 14:16:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:05 devstack sudo[112613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info Jun 23 14:16:05 devstack sudo[112613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:05 devstack sudo[112613]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.info" returned: 0 in 0.795s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.509s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:05 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8757b1d4-2f84-4995-9dce-72b4cd0ecbd6 tempest-VolumeDependencyTests-1919431740 None] Create snapshot completed successfully Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=134,cinder:UPDATE=199,cinder:DELETE=18,cinder:INSERT=40 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Flow 'volume_create_manager' (b38ebef0-bc2e-47db-ae8f-43c6b0725d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff34cd-5a34-4a78-b03d-ac8919ab578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bff34cd-5a34-4a78-b03d-ac8919ab578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-567057719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7db1335-86ee-433b-81c9-16b89dadbacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4586d149bbf4d3aba3cb5173c5e762c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55aa66f7-0332-4869-b76c-e9719ecf4cc1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:07Z,use_quota=True,user_id='d58c78b4afe34d838d494f57aa978377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2067446c-111e-4680-8104-2d9e7161d046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2067446c-111e-4680-8104-2d9e7161d046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36885838-c0b4-46d4-a50b-773862814006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36885838-c0b4-46d4-a50b-773862814006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7db1335-86ee-433b-81c9-16b89dadbacd', 'volume_name': 'volume-d7db1335-86ee-433b-81c9-16b89dadbacd', 'volume_size': 1, 'snapshot_id': '55aa66f7-0332-4869-b76c-e9719ecf4cc1'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f17de-bee8-4972-8394-17345b9a142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f17de-bee8-4972-8394-17345b9a142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c93202-5563-4211-a423-739c5f3987e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:07 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Volume d7db1335-86ee-433b-81c9-16b89dadbacd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7db1335-86ee-433b-81c9-16b89dadbacd', 'volume_size': 1, 'snapshot_id': '55aa66f7-0332-4869-b76c-e9719ecf4cc1'} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-quobyte-55aa66f7-0332-4869-b76c-e9719ecf4cc1-d7db1335-86ee-433b-81c9-16b89dadbacd" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-55aa66f7-0332-4869-b76c-e9719ecf4cc1-d7db1335-86ee-433b-81c9-16b89dadbacd" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Creating volume d7db1335-86ee-433b-81c9-16b89dadbacd from snapshot 55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-quobyte-d7db1335-86ee-433b-81c9-16b89dadbacd" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-d7db1335-86ee-433b-81c9-16b89dadbacd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] snapshot: 55aa66f7-0332-4869-b76c-e9719ecf4cc1, volume: d7db1335-86ee-433b-81c9-16b89dadbacd, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ff5ae-91e3-4558-824a-b73cf929dd9e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:07 devstack sudo[112619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 Jun 23 14:16:07 devstack sudo[112619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Flow 'volume_create_manager' (e1815539-73f0-4c66-b17d-72ffd8827528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2e6589-d926-44dd-a2c2-5b671d22d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2e6589-d926-44dd-a2c2-5b671d22d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83aab434-8bde-4361-88c2-f3e5494e3e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e03f375ac2246898ea1948c39a3730e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:08Z,use_quota=True,user_id='646ace335036487ca3396084ec6ab222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3b171f-a395-4f20-95ac-688f448f2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3b171f-a395-4f20-95ac-688f448f2c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318f90ec-480c-4505-bb71-1fc22b8a2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318f90ec-480c-4505-bb71-1fc22b8a2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83aab434-8bde-4361-88c2-f3e5494e3e4d', 'volume_name': 'volume-83aab434-8bde-4361-88c2-f3e5494e3e4d', 'volume_size': 1, 'image_id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98f122b5f35fea5e0ec4692f43fc004f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e03f375ac2246898ea1948c39a3730e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54fcec82ff67fa2027ee3ba307cba315db6fa294ca2e91c1a94aedc77cabe111cf1587d5767185a455b7a7ca470bf9f5c5e5c565053c6ee0d0c1ad0f5906587a', 'id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'created_at': datetime.datetime(2026, 6, 23, 12, 16, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 16, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4/file', 'properties': {}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24808c70-0e05-44e3-a0a9-a65d033f9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24808c70-0e05-44e3-a0a9-a65d033f9077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d26fae2-d364-40d7-9bc6-df05a4f15661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:08 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Volume 83aab434-8bde-4361-88c2-f3e5494e3e4d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83aab434-8bde-4361-88c2-f3e5494e3e4d', 'volume_size': 1, 'image_id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98f122b5f35fea5e0ec4692f43fc004f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e03f375ac2246898ea1948c39a3730e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54fcec82ff67fa2027ee3ba307cba315db6fa294ca2e91c1a94aedc77cabe111cf1587d5767185a455b7a7ca470bf9f5c5e5c565053c6ee0d0c1ad0f5906587a', 'id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'created_at': datetime.datetime(2026, 6, 23, 12, 16, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 16, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4/file', 'properties': {}}, 'image_service': } Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Trying to clone 83aab434-8bde-4361-88c2-f3e5494e3e4d from image 353ca45d-a1a4-4b25-9e54-9e09caed02d4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:16:08 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c73ba-d6c6-44ea-8974-6857720e547e]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:08 devstack sudo[112619]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1" returned: 0 in 1.018s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc273673-e040-4b66-a7fc-11b0fd982281(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b66bc9-cd91-4138-990e-cb0cf3017810]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:08 devstack sudo[112624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD Jun 23 14:16:08 devstack sudo[112624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:08 devstack sudo[112625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:16:08 devstack sudo[112625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:09 devstack sudo[112624]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:09 devstack sudo[112625]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 0.928s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:09 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:16:09 devstack sudo[112633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD Jun 23 14:16:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:09 devstack sudo[112633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:09 devstack sudo[112635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd Jun 23 14:16:09 devstack sudo[112635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:10 devstack sudo[112633]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD" returned: 1 in 0.941s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:10 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Temporary image 353ca45d-a1a4-4b25-9e54-9e09caed02d4 is fetched for user 646ace335036487ca3396084ec6ab222. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:16:10 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceefb4f-fb66-4dd6-8ff0-68cad5859e8a]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:10 devstack sudo[112650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD Jun 23 14:16:10 devstack sudo[112650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:12 devstack sudo[112650]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD" returned: 0 in 2.111s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:13 devstack sudo[112655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD Jun 23 14:16:13 devstack sudo[112655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:14 devstack sudo[112655]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD" returned: 1 in 1.772s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:14 devstack sudo[112635]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd" returned: 0 in 5.201s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:14 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[2793dea3-06a3-4637-b45a-786451b0a790]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:14 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:16:14 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:15 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 1.043s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:15 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:16:15 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Converted 1024.00 MB image at 196.84 MB/s Jun 23 14:16:15 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd is being set with open permissions: ugo+rw Jun 23 14:16:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:15 devstack sudo[112666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd Jun 23 14:16:15 devstack sudo[112666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:16 devstack sudo[112666]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd" returned: 0 in 0.704s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-d7db1335-86ee-433b-81c9-16b89dadbacd" released by "_copy_volume_from_snapshot" :: held 9.011s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-55aa66f7-0332-4869-b76c-e9719ecf4cc1-d7db1335-86ee-433b-81c9-16b89dadbacd" released by "_create_volume_from_snapshot" :: held 9.052s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.075s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83aab434-8bde-4361-88c2-f3e5494e3e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e03f375ac2246898ea1948c39a3730e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:08Z,use_quota=True,user_id='646ace335036487ca3396084ec6ab222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Creating volume 83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:16 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:16 devstack sudo[112669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d 1073741824 Jun 23 14:16:16 devstack sudo[112669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c93202-5563-4211-a423-739c5f3987e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7db1335-86ee-433b-81c9-16b89dadbacd', 'volume_size': 1, 'snapshot_id': '55aa66f7-0332-4869-b76c-e9719ecf4cc1'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb7a9e-1405-4819-a0b3-c193c48fd425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Volume volume-d7db1335-86ee-433b-81c9-16b89dadbacd (d7db1335-86ee-433b-81c9-16b89dadbacd): created successfully Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fb7a9e-1405-4819-a0b3-c193c48fd425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Flow 'volume_create_manager' (b38ebef0-bc2e-47db-ae8f-43c6b0725d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:16 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-abb42d03-1874-4549-b9b9-b850abc6d40c tempest-VolumeDependencyTests-1919431740 None] Created volume successfully. Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-55aa66f7-0332-4869-b76c-e9719ecf4cc1-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-55aa66f7-0332-4869-b76c-e9719ecf4cc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-quobyte-fc273673-e040-4b66-a7fc-11b0fd982281" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-fc273673-e040-4b66-a7fc-11b0fd982281" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-quobyte-55aa66f7-0332-4869-b76c-e9719ecf4cc1" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-55aa66f7-0332-4869-b76c-e9719ecf4cc1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Deleting offline snapshot 55aa66f7-0332-4869-b76c-e9719ecf4cc1 of volume fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] snapshot_file for this snap is: volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e23da8-3a1f-4b9f-baf7-77b0e81b399b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:17 devstack sudo[112674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 Jun 23 14:16:17 devstack sudo[112674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:17 devstack sudo[112669]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d 1073741824" returned: 0 in 0.974s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:17 devstack sudo[112677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:17 devstack sudo[112677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:18 devstack sudo[112674]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1" returned: 0 in 0.845s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc273673-e040-4b66-a7fc-11b0fd982281(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6794091-ca71-447e-bc1e-11453f820e69]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:18 devstack sudo[112677]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 0 in 0.682s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:18 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:16:18 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Attempting download of 353ca45d-a1a4-4b25-9e54-9e09caed02d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'metadata': {}}])) to volume 83aab434-8bde-4361-88c2-f3e5494e3e4d. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973d897-08a5-451c-87c4-b21427b9de7e]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:18 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft Jun 23 14:16:18 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 0.823s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:19 devstack sudo[112690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 Jun 23 14:16:19 devstack sudo[112690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft" returned: 0 in 0.838s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:19 devstack sudo[112694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft Jun 23 14:16:19 devstack sudo[112694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[112690]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1" returned: 0 in 0.837s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:19 devstack sudo[112701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1 Jun 23 14:16:19 devstack sudo[112701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:19 devstack sudo[112694]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft" returned: 1 in 0.756s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_353ca45d-a1a4-4b25-9e54-9e09caed02d4_6igie5ft' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[52277627-c2ed-4c37-a98b-d7654132de0f]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:20 devstack sudo[112703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD Jun 23 14:16:20 devstack sudo[112703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:20 devstack sudo[112701]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281.55aa66f7-0332-4869-b76c-e9719ecf4cc1" returned: 0 in 0.721s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-55aa66f7-0332-4869-b76c-e9719ecf4cc1" released by "_delete_snapshot" :: held 3.344s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-fc273673-e040-4b66-a7fc-11b0fd982281" released by "delete_snapshot" :: held 3.370s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Created reservations ['d4068f0f-1606-4deb-b9a4-cee8cc6b8f64', '6b041f33-80f8-40a2-a272-25c812c86d69', 'efd63e54-eb29-4ddf-959c-1127f0f90ef2', '2d604355-2a30-4003-b85a-2d07c52366f3'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:20 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Delete snapshot completed successfully. Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cd703ef2-0e8b-4041-9c46-46ecf5ad985d tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-55aa66f7-0332-4869-b76c-e9719ecf4cc1-delete_snapshot" released by "delete_snapshot" :: held 3.571s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:20 devstack sudo[112703]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:20 devstack sudo[112709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD Jun 23 14:16:20 devstack sudo[112709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-fc273673-e040-4b66-a7fc-11b0fd982281-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-fc273673-e040-4b66-a7fc-11b0fd982281-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:21 devstack sudo[112709]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD" returned: 1 in 0.774s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] 353ca45d-a1a4-4b25-9e54-9e09caed02d4 was raw, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:21 devstack sudo[112714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:21 devstack sudo[112714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-quobyte-fc273673-e040-4b66-a7fc-11b0fd982281" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-fc273673-e040-4b66-a7fc-11b0fd982281" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47e1ed-a778-4132-bf5b-af5b3f772c36]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:21 devstack sudo[112716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:16:21 devstack sudo[112716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:22 devstack sudo[112714]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 0 in 0.795s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:22 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_353ca45d-a1a4-4b25-9e54-9e09caed02d4_2_y_tyjhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:16:22 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:16:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:22 devstack sudo[112721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d 1G Jun 23 14:16:22 devstack sudo[112721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:22 devstack sudo[112716]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 0.921s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:22 devstack sudo[112726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281 Jun 23 14:16:22 devstack sudo[112726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:23 devstack sudo[112721]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d 1G" returned: 0 in 0.780s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdd111e-c3c2-4572-9017-cb689460e4c2]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:23 devstack sudo[112731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:23 devstack sudo[112731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:23 devstack sudo[112726]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fc273673-e040-4b66-a7fc-11b0fd982281" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-fc273673-e040-4b66-a7fc-11b0fd982281" released by "delete_volume" :: held 1.800s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Created reservations ['692f3081-e06c-4fe6-989b-1fe981e2da48', '6ed2e52e-df2b-471c-9924-a5c52c741f1d', '4b1bf855-f1ba-418d-bd66-4f56b6af3869', '99105191-fca3-4edf-840f-3ed18d68c672'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:23 devstack sudo[112735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:23 devstack sudo[112735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-d7db1335-86ee-433b-81c9-16b89dadbacd-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-d7db1335-86ee-433b-81c9-16b89dadbacd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "cinder-quobyte-d7db1335-86ee-433b-81c9-16b89dadbacd" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-d7db1335-86ee-433b-81c9-16b89dadbacd" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb9e199-9b57-41da-b9c0-e68f3e820e32]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:24 devstack sudo[112731]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 0 in 0.856s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:24 devstack sudo[112739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd Jun 23 14:16:24 devstack sudo[112739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:24 devstack sudo[112740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:24 devstack sudo[112740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:24 devstack sudo[112735]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.776s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Deleted volume successfully. Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bbfe8667-bc94-4932-918a-94c843412e89 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-fc273673-e040-4b66-a7fc-11b0fd982281-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:24 devstack sudo[112739]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd" returned: 0 in 0.890s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:24 devstack sudo[112750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd Jun 23 14:16:24 devstack sudo[112750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:24 devstack sudo[112740]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 1 in 0.844s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Downloaded image 353ca45d-a1a4-4b25-9e54-9e09caed02d4 ((None, [{'url': 'file:///opt/stack/data/glance/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'metadata': {}}])) to volume 83aab434-8bde-4361-88c2-f3e5494e3e4d successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Temporary image 353ca45d-a1a4-4b25-9e54-9e09caed02d4 for user 646ace335036487ca3396084ec6ab222 is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Marking volume 83aab434-8bde-4361-88c2-f3e5494e3e4d as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Copying metadata from image 353ca45d-a1a4-4b25-9e54-9e09caed02d4 to 83aab434-8bde-4361-88c2-f3e5494e3e4d. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:16:24 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Creating volume glance metadata for volume 83aab434-8bde-4361-88c2-f3e5494e3e4d backed by image 353ca45d-a1a4-4b25-9e54-9e09caed02d4 with: {'image_id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '98f122b5f35fea5e0ec4692f43fc004f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d26fae2-d364-40d7-9bc6-df05a4f15661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83aab434-8bde-4361-88c2-f3e5494e3e4d', 'volume_size': 1, 'image_id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '98f122b5f35fea5e0ec4692f43fc004f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9e03f375ac2246898ea1948c39a3730e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '54fcec82ff67fa2027ee3ba307cba315db6fa294ca2e91c1a94aedc77cabe111cf1587d5767185a455b7a7ca470bf9f5c5e5c565053c6ee0d0c1ad0f5906587a', 'id': '353ca45d-a1a4-4b25-9e54-9e09caed02d4', 'created_at': datetime.datetime(2026, 6, 23, 12, 16, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 16, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/353ca45d-a1a4-4b25-9e54-9e09caed02d4/file', 'properties': {}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ae1311-4b9c-4351-8a89-b1b8387f1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Volume volume-83aab434-8bde-4361-88c2-f3e5494e3e4d (83aab434-8bde-4361-88c2-f3e5494e3e4d): created successfully Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ae1311-4b9c-4351-8a89-b1b8387f1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Flow 'volume_create_manager' (e1815539-73f0-4c66-b17d-72ffd8827528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:25 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-93be69c1-5a30-4fd5-9cbf-746fcbe39e63 tempest-VolumeImageDependencyTests-1176460990 None] Created volume successfully. Jun 23 14:16:25 devstack sudo[112750]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d7db1335-86ee-433b-81c9-16b89dadbacd" returned: 0 in 0.758s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-quobyte-d7db1335-86ee-433b-81c9-16b89dadbacd" released by "delete_volume" :: held 1.703s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Created reservations ['be134bc1-3a64-40e6-ac93-aace753cd37d', 'b0a20f23-a4f5-46ea-80f1-03e32cccdab5', '9c676a71-fbdc-4085-a551-2dd909e313e7', 'd5227914-3aa7-48ca-90d2-6668c3cc7c7c'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Acquiring lock "cinder-83aab434-8bde-4361-88c2-f3e5494e3e4d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Lock "cinder-83aab434-8bde-4361-88c2-f3e5494e3e4d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:25 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:25 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Acquiring lock "cinder-quobyte-83aab434-8bde-4361-88c2-f3e5494e3e4d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Lock "cinder-quobyte-83aab434-8bde-4361-88c2-f3e5494e3e4d" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792045a-f155-4009-9157-aa1d4d689602]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:26 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:26 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:26 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.813s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:26 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Deleted volume successfully. Jun 23 14:16:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c5129acb-b4dc-4041-b6f5-0bd455f87390 tempest-VolumeDependencyTests-1919431740 None] Lock "cinder-d7db1335-86ee-433b-81c9-16b89dadbacd-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:26 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 0 in 0.908s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:27 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:27 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:27 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 1 in 0.920s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:16:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:27 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d Jun 23 14:16:27 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:28 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-83aab434-8bde-4361-88c2-f3e5494e3e4d" returned: 0 in 0.722s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Lock "cinder-quobyte-83aab434-8bde-4361-88c2-f3e5494e3e4d" released by "delete_volume" :: held 2.625s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Created reservations ['08d6d1a4-479b-4432-a7d0-ff75f88118b2', 'e12dff8d-273e-45f8-a3d9-4cbf49687f9c', '2815c5e7-f423-422c-bec1-d0df314dacc7', '4b37993c-b9ff-417e-a542-b6e37d40eb3a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:28 devstack sudo[112768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:28 devstack sudo[112768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:29 devstack sudo[112768]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.776s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:29 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Deleted volume successfully. Jun 23 14:16:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1b1d4041-3ae3-4526-98b8-b7f8661f2a84 tempest-VolumeImageDependencyTests-1176460990 None] Lock "cinder-83aab434-8bde-4361-88c2-f3e5494e3e4d-delete_volume" released by "delete_volume" :: held 3.732s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:29 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Flow 'volume_create_manager' (4f6edc71-b04f-4c10-8af8-f8060f757135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e185b0-28ce-498d-a866-822e71781205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38e185b0-28ce-498d-a866-822e71781205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb046f1-a1a0-4647-9207-8746bb58dea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ad2930b74ed18d7e044335486317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:30Z,use_quota=True,user_id='eb2be2fe0fe440b68d83ce03e8f47f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5dcbd2-3cb3-4580-8fd0-1281d841d643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5dcbd2-3cb3-4580-8fd0-1281d841d643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79277808-461a-43aa-8e98-a1c476d532b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79277808-461a-43aa-8e98-a1c476d532b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb046f1-a1a0-4647-9207-8746bb58dea4', 'volume_name': 'volume-fcb046f1-a1a0-4647-9207-8746bb58dea4', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac07c664-f019-4bb2-903d-bc60508ba764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac07c664-f019-4bb2-903d-bc60508ba764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9e030c-5f77-422e-86c0-4e2def505751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:30 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Volume fcb046f1-a1a0-4647-9207-8746bb58dea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb046f1-a1a0-4647-9207-8746bb58dea4', 'volume_size': 1} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb046f1-a1a0-4647-9207-8746bb58dea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ad2930b74ed18d7e044335486317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:30Z,use_quota=True,user_id='eb2be2fe0fe440b68d83ce03e8f47f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Creating volume fcb046f1-a1a0-4647-9207-8746bb58dea4 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:30 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:16:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:30 devstack sudo[112771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 1073741824 Jun 23 14:16:30 devstack sudo[112771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:31 devstack sudo[112771]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 1073741824" returned: 0 in 1.071s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:31 devstack sudo[112776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 Jun 23 14:16:31 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:31 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4" returned: 0 in 0.770s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9e030c-5f77-422e-86c0-4e2def505751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb046f1-a1a0-4647-9207-8746bb58dea4', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac89f4d-d950-430a-b1aa-4208276da104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:32 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Volume volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 (fcb046f1-a1a0-4647-9207-8746bb58dea4): created successfully Jun 23 14:16:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac89f4d-d950-430a-b1aa-4208276da104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:32 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Flow 'volume_create_manager' (4f6edc71-b04f-4c10-8af8-f8060f757135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-187e4207-caf3-44b5-8b62-88b83d20e8db tempest-CinderUnicodeTest-575817571 None] Created volume successfully. Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Flow 'volume_create_manager' (e8d25bc6-ac19-4417-b400-ee4318eb6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c24536-d1e8-458a-b380-04120ff0cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c24536-d1e8-458a-b380-04120ff0cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1247191263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53f2003-7c60-4770-b175-4772a825b783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ad2930b74ed18d7e044335486317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:34Z,use_quota=True,user_id='eb2be2fe0fe440b68d83ce03e8f47f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce9339c-eb9d-40c6-93dd-affc9b6b9a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce9339c-eb9d-40c6-93dd-affc9b6b9a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e5fc38-9cf6-43fa-b185-e0e7a3579ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e5fc38-9cf6-43fa-b185-e0e7a3579ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53f2003-7c60-4770-b175-4772a825b783', 'volume_name': 'volume-e53f2003-7c60-4770-b175-4772a825b783', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63856ac8-256d-4ed2-b3ac-16832c4bde94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63856ac8-256d-4ed2-b3ac-16832c4bde94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddad877-5b94-43bc-bfbb-c01277b14ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:33 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Volume e53f2003-7c60-4770-b175-4772a825b783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53f2003-7c60-4770-b175-4772a825b783', 'volume_size': 1} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:16:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1247191263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53f2003-7c60-4770-b175-4772a825b783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf2ad2930b74ed18d7e044335486317',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:16:34Z,use_quota=True,user_id='eb2be2fe0fe440b68d83ce03e8f47f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Creating volume e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:16:33 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:16:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:33 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 1073741824 Jun 23 14:16:33 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:34 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 1073741824" returned: 0 in 0.967s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:34 devstack sudo[112787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 Jun 23 14:16:34 devstack sudo[112787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:35 devstack sudo[112787]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783" returned: 0 in 0.704s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddad877-5b94-43bc-bfbb-c01277b14ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53f2003-7c60-4770-b175-4772a825b783', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4edd587-1940-47d5-8ed8-8a0455c112ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:16:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Volume volume-e53f2003-7c60-4770-b175-4772a825b783 (e53f2003-7c60-4770-b175-4772a825b783): created successfully Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4edd587-1940-47d5-8ed8-8a0455c112ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:16:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Flow 'volume_create_manager' (e8d25bc6-ac19-4417-b400-ee4318eb6816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:16:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-78b88cc4-fa25-4636-aac2-c40333408bcd tempest-CinderUnicodeTest-575817571 None] Created volume successfully. Jun 23 14:16:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Creating offline snapshot da040e44-c93c-42f5-aaf0-360926c7a209 of volume e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:16:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd42c0f-1cc1-48e7-b870-a2efdb51fb85]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:36 devstack sudo[112790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 Jun 23 14:16:36 devstack sudo[112790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:37 devstack sudo[112790]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783" returned: 0 in 0.855s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:37 devstack sudo[112795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 1G Jun 23 14:16:37 devstack sudo[112795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:38 devstack sudo[112795]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 1G" returned: 0 in 0.992s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e53f2003-7c60-4770-b175-4772a825b783 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:38 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e53f2003-7c60-4770-b175-4772a825b783 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 Jun 23 14:16:38 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:38 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e53f2003-7c60-4770-b175-4772a825b783 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209" returned: 0 in 0.863s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:38 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 is being set with open permissions: ugo+rw Jun 23 14:16:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:38 devstack sudo[112807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 Jun 23 14:16:38 devstack sudo[112807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:39 devstack sudo[112807]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209" returned: 0 in 0.778s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:39 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info Jun 23 14:16:39 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:40 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info" returned: 0 in 0.777s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:40 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info is being set with open permissions: ugo+rw Jun 23 14:16:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:40 devstack sudo[112813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info Jun 23 14:16:40 devstack sudo[112813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:41 devstack sudo[112813]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.info" returned: 0 in 0.805s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.178s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:41 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=104,cinder:UPDATE=144,cinder:DELETE=14,cinder:INSERT=38 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:16:41 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-023f2e45-3918-4f27-a3b4-c2539cf490e7 tempest-CinderUnicodeTest-575817571 None] Create snapshot completed successfully Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-da040e44-c93c-42f5-aaf0-360926c7a209-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-da040e44-c93c-42f5-aaf0-360926c7a209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-quobyte-e53f2003-7c60-4770-b175-4772a825b783" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-e53f2003-7c60-4770-b175-4772a825b783" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-quobyte-da040e44-c93c-42f5-aaf0-360926c7a209" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-da040e44-c93c-42f5-aaf0-360926c7a209" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Deleting offline snapshot da040e44-c93c-42f5-aaf0-360926c7a209 of volume e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] snapshot_file for this snap is: volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422e01f-d811-4453-a922-a8cfdc30af88]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:42 devstack sudo[112816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 Jun 23 14:16:42 devstack sudo[112816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:43 devstack sudo[112816]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209" returned: 0 in 0.901s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e53f2003-7c60-4770-b175-4772a825b783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:16:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[06724883-3062-40a4-b163-401ffa2b331f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:43 devstack sudo[112821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 Jun 23 14:16:43 devstack sudo[112821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:44 devstack sudo[112821]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783" returned: 0 in 0.879s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:44 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 Jun 23 14:16:44 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:45 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:45 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209 Jun 23 14:16:45 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:45 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783.da040e44-c93c-42f5-aaf0-360926c7a209" returned: 0 in 0.693s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-da040e44-c93c-42f5-aaf0-360926c7a209" released by "_delete_snapshot" :: held 3.422s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-e53f2003-7c60-4770-b175-4772a825b783" released by "delete_snapshot" :: held 3.446s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Created reservations ['32bcf98b-fec9-488c-9858-3820417001a1', '439786bc-a47f-4c07-9a9c-45e900db06f5', '9e2bdea7-00e8-47ff-acb1-eb283b92f713', '2e4e86a8-118b-4dfa-b1e9-1b4abb616946'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Delete snapshot completed successfully. Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8323ac0c-1d28-4b92-9439-251179f89ecb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-da040e44-c93c-42f5-aaf0-360926c7a209-delete_snapshot" released by "delete_snapshot" :: held 3.600s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-e53f2003-7c60-4770-b175-4772a825b783-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-e53f2003-7c60-4770-b175-4772a825b783-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-quobyte-e53f2003-7c60-4770-b175-4772a825b783" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-e53f2003-7c60-4770-b175-4772a825b783" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb98bd6-ef90-475a-b3ca-1fbfc0dff176]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:46 devstack sudo[112872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 Jun 23 14:16:46 devstack sudo[112872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:47 devstack sudo[112872]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783" returned: 0 in 0.885s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:47 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783 Jun 23 14:16:47 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:48 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-e53f2003-7c60-4770-b175-4772a825b783" returned: 0 in 0.723s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-e53f2003-7c60-4770-b175-4772a825b783" released by "delete_volume" :: held 1.673s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Created reservations ['02b1d66a-1e24-4986-a214-7742c1d2cafa', 'b43ebb99-b87f-4a34-b73e-ecbcdc7d02ff', '31d23437-e711-427d-9b5c-e03d806361ac', 'cab0cc5a-2a7b-44e9-9b20-648baff2f617'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:48 devstack sudo[112882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:48 devstack sudo[112882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-fcb046f1-a1a0-4647-9207-8746bb58dea4-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Lock "cinder-fcb046f1-a1a0-4647-9207-8746bb58dea4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Acquiring lock "cinder-quobyte-fcb046f1-a1a0-4647-9207-8746bb58dea4" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-fcb046f1-a1a0-4647-9207-8746bb58dea4" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6d175-daf7-4e28-adb5-535e11ddd63e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:49 devstack sudo[112884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 Jun 23 14:16:49 devstack sudo[112884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:49 devstack sudo[112882]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.770s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Deleted volume successfully. Jun 23 14:16:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9f8c8277-3212-49cb-b00a-c8f6a479febb tempest-CinderUnicodeTest-575817571 None] Lock "cinder-e53f2003-7c60-4770-b175-4772a825b783-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:50 devstack sudo[112884]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4" returned: 0 in 0.874s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:50 devstack sudo[112890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4 Jun 23 14:16:50 devstack sudo[112890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:50 devstack sudo[112890]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-fcb046f1-a1a0-4647-9207-8746bb58dea4" returned: 0 in 0.784s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Lock "cinder-quobyte-fcb046f1-a1a0-4647-9207-8746bb58dea4" released by "delete_volume" :: held 1.710s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Created reservations ['b2ec6420-c8f7-4740-a5be-b10f1c4df6ce', 'cd953aa7-b358-45bb-9cb1-66388d033f58', '397b4d29-8793-4ad0-b040-5e90629298ae', 'cbbc0598-0f2b-4deb-b445-48f4146566b1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:50 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:50 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:16:51 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.759s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Deleted volume successfully. Jun 23 14:16:51 devstack sudo[112896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:16:51 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:16:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7490d3b9-0898-46f9-bd8c-b5cd9611ad5f tempest-CinderUnicodeTest-575817571 None] Lock "cinder-fcb046f1-a1a0-4647-9207-8746bb58dea4-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:16:52 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root Jun 23 14:16:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.820s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:16:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:16:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:16:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:16:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:17:00 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=49,cinder:UPDATE=62,cinder:DELETE=6,cinder:INSERT=20 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:17:01 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Flow 'volume_create_manager' (412e7939-40e3-4006-b83c-d7841ccc0d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a58f41d-1cad-4ebd-ad61-2745f8ae4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a58f41d-1cad-4ebd-ad61-2745f8ae4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-824913056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074510ab-ab2d-4326-be9b-3541686d1ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e83462fecf417090cb810117873531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:17Z,use_quota=True,user_id='f1f8cddf719f42baaa97d612f60d1c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdcd8b7-5b11-4afa-8b3a-78a4db0c9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdcd8b7-5b11-4afa-8b3a-78a4db0c9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d449f871-2040-4c17-af8d-601ce49ff57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d449f871-2040-4c17-af8d-601ce49ff57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074510ab-ab2d-4326-be9b-3541686d1ed9', 'volume_name': 'volume-074510ab-ab2d-4326-be9b-3541686d1ed9', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8cb35e-b060-40d8-a356-5360de3cb9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8cb35e-b060-40d8-a356-5360de3cb9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb2589b-0f79-43ad-b086-f63ee94a7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Volume 074510ab-ab2d-4326-be9b-3541686d1ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074510ab-ab2d-4326-be9b-3541686d1ed9', 'volume_size': 1} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-824913056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074510ab-ab2d-4326-be9b-3541686d1ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e83462fecf417090cb810117873531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:17Z,use_quota=True,user_id='f1f8cddf719f42baaa97d612f60d1c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Creating volume 074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:17 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:17:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:17 devstack sudo[112913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 1073741824 Jun 23 14:17:17 devstack sudo[112913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:18 devstack sudo[112913]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 1073741824" returned: 0 in 1.016s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:18 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:18 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:19 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 0.761s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb2589b-0f79-43ad-b086-f63ee94a7c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074510ab-ab2d-4326-be9b-3541686d1ed9', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af78fe4-bae7-440c-9385-951e08a2e69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:19 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Volume volume-074510ab-ab2d-4326-be9b-3541686d1ed9 (074510ab-ab2d-4326-be9b-3541686d1ed9): created successfully Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af78fe4-bae7-440c-9385-951e08a2e69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Flow 'volume_create_manager' (412e7939-40e3-4006-b83c-d7841ccc0d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7dcad5e8-6d71-457d-8044-79c08508d666 tempest-SnapshotDependencyTests-904217876 None] Created volume successfully. Jun 23 14:17:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Creating offline snapshot 601c4c20-42cc-40d8-9ed0-768b2f67290a of volume 074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:17:20 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d696c88-00c3-47f9-8a2b-a2c4b97f8b89]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:21 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:21 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:21 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 0.980s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:22 devstack sudo[112927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a 1G Jun 23 14:17:22 devstack sudo[112927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:22 devstack sudo[112927]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a 1G" returned: 0 in 0.965s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074510ab-ab2d-4326-be9b-3541686d1ed9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:22 devstack sudo[112933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074510ab-ab2d-4326-be9b-3541686d1ed9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a Jun 23 14:17:22 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:23 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074510ab-ab2d-4326-be9b-3541686d1ed9 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a" returned: 0 in 0.797s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:23 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a is being set with open permissions: ugo+rw Jun 23 14:17:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:23 devstack sudo[112939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a Jun 23 14:17:23 devstack sudo[112939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:24 devstack sudo[112939]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a" returned: 0 in 0.766s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:24 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info Jun 23 14:17:24 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:25 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info" returned: 0 in 0.791s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:25 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info is being set with open permissions: ugo+rw Jun 23 14:17:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:25 devstack sudo[112945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info Jun 23 14:17:25 devstack sudo[112945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:26 devstack sudo[112945]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.info" returned: 0 in 0.774s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.195s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7c9ce2d4-a49a-4a95-9ba7-c260c3b071b6 tempest-SnapshotDependencyTests-904217876 None] Create snapshot completed successfully Jun 23 14:17:29 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:17:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Flow 'volume_create_manager' (12050526-3152-4c82-9f4c-5f29faccd3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdbff2c-e9cb-4ee8-8410-9f4531dd20bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdbff2c-e9cb-4ee8-8410-9f4531dd20bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf74707-2a67-4e48-a82d-ab744e10d36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e83462fecf417090cb810117873531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=601c4c20-42cc-40d8-9ed0-768b2f67290a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:17:30Z,use_quota=True,user_id='f1f8cddf719f42baaa97d612f60d1c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f7c439-3fcb-4feb-b922-a908c5814317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f7c439-3fcb-4feb-b922-a908c5814317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016ab6e2-7048-49bc-b200-061e3011c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016ab6e2-7048-49bc-b200-061e3011c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'faf74707-2a67-4e48-a82d-ab744e10d36d', 'volume_name': 'volume-faf74707-2a67-4e48-a82d-ab744e10d36d', 'volume_size': 1, 'snapshot_id': '601c4c20-42cc-40d8-9ed0-768b2f67290a'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad67d47-5ba2-4f67-8699-65b4001cda45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad67d47-5ba2-4f67-8699-65b4001cda45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0bbb64-bc72-4a63-b718-6ceded03d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:30 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Volume faf74707-2a67-4e48-a82d-ab744e10d36d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-faf74707-2a67-4e48-a82d-ab744e10d36d', 'volume_size': 1, 'snapshot_id': '601c4c20-42cc-40d8-9ed0-768b2f67290a'} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-quobyte-601c4c20-42cc-40d8-9ed0-768b2f67290a-faf74707-2a67-4e48-a82d-ab744e10d36d" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-601c4c20-42cc-40d8-9ed0-768b2f67290a-faf74707-2a67-4e48-a82d-ab744e10d36d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Creating volume faf74707-2a67-4e48-a82d-ab744e10d36d from snapshot 601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-quobyte-faf74707-2a67-4e48-a82d-ab744e10d36d" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-faf74707-2a67-4e48-a82d-ab744e10d36d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] snapshot: 601c4c20-42cc-40d8-9ed0-768b2f67290a, volume: faf74707-2a67-4e48-a82d-ab744e10d36d, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4df29-7faa-4391-ac90-6cee60691a1f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:30 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a Jun 23 14:17:30 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:30 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a" returned: 0 in 0.846s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074510ab-ab2d-4326-be9b-3541686d1ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbddafdc-01bb-44a0-8d91-74898f4bfba7]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:31 devstack sudo[112953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:31 devstack sudo[112953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:31 devstack sudo[112953]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 0.839s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:17:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:31 devstack sudo[112958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d Jun 23 14:17:31 devstack sudo[112958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:36 devstack sudo[112958]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d" returned: 0 in 5.113s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f6d534-86cb-4867-a96d-bea86b9e42c6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:37 devstack sudo[112973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:37 devstack sudo[112973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:37 devstack sudo[112973]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 1.010s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:17:38 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Converted 1024.00 MB image at 200.22 MB/s Jun 23 14:17:38 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d is being set with open permissions: ugo+rw Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:38 devstack sudo[112978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d Jun 23 14:17:38 devstack sudo[112978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:38 devstack sudo[112978]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d" returned: 0 in 0.793s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-faf74707-2a67-4e48-a82d-ab744e10d36d" released by "_copy_volume_from_snapshot" :: held 8.702s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-601c4c20-42cc-40d8-9ed0-768b2f67290a-faf74707-2a67-4e48-a82d-ab744e10d36d" released by "_create_volume_from_snapshot" :: held 8.736s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.759s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0bbb64-bc72-4a63-b718-6ceded03d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf74707-2a67-4e48-a82d-ab744e10d36d', 'volume_size': 1, 'snapshot_id': '601c4c20-42cc-40d8-9ed0-768b2f67290a'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685158a7-96ef-4532-9022-1eec513f4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:17:38 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Volume volume-faf74707-2a67-4e48-a82d-ab744e10d36d (faf74707-2a67-4e48-a82d-ab744e10d36d): created successfully Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685158a7-96ef-4532-9022-1eec513f4441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:17:38 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Flow 'volume_create_manager' (12050526-3152-4c82-9f4c-5f29faccd3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:17:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7378ac0b-9c26-4d61-8493-6f6d4355c782 tempest-SnapshotDependencyTests-904217876 None] Created volume successfully. Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-601c4c20-42cc-40d8-9ed0-768b2f67290a-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-601c4c20-42cc-40d8-9ed0-768b2f67290a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-quobyte-074510ab-ab2d-4326-be9b-3541686d1ed9" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-074510ab-ab2d-4326-be9b-3541686d1ed9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-quobyte-601c4c20-42cc-40d8-9ed0-768b2f67290a" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-601c4c20-42cc-40d8-9ed0-768b2f67290a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Deleting offline snapshot 601c4c20-42cc-40d8-9ed0-768b2f67290a of volume 074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] snapshot_file for this snap is: volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[10abf836-ad2c-4cfb-b250-b5616ecfc6ba]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:40 devstack sudo[112981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a Jun 23 14:17:40 devstack sudo[112981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:40 devstack sudo[112981]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a" returned: 0 in 0.802s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074510ab-ab2d-4326-be9b-3541686d1ed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6001cd-3912-417a-a668-4a3ba65cab63]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:41 devstack sudo[112986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:41 devstack sudo[112986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:41 devstack sudo[112986]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 0.976s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:41 devstack sudo[112991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a Jun 23 14:17:41 devstack sudo[112991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:42 devstack sudo[112991]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a" returned: 0 in 0.916s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:42 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a Jun 23 14:17:42 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:43 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9.601c4c20-42cc-40d8-9ed0-768b2f67290a" returned: 0 in 0.764s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-601c4c20-42cc-40d8-9ed0-768b2f67290a" released by "_delete_snapshot" :: held 3.570s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-074510ab-ab2d-4326-be9b-3541686d1ed9" released by "delete_snapshot" :: held 3.599s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:43 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Created reservations ['3a7a7756-4de3-4336-bfea-83ea0c9b2ab9', 'bfb2c175-000d-4d29-b331-0e0dcdedaeed', 'dec4c02a-7a5e-4131-bf67-ace5f267823d', '650b57b6-26f7-4c79-9dce-f1f912bd15de'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Delete snapshot completed successfully. Jun 23 14:17:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-dc0b2667-a7da-4221-b951-95f6c15ad115 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-601c4c20-42cc-40d8-9ed0-768b2f67290a-delete_snapshot" released by "delete_snapshot" :: held 3.784s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-074510ab-ab2d-4326-be9b-3541686d1ed9-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-074510ab-ab2d-4326-be9b-3541686d1ed9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-quobyte-074510ab-ab2d-4326-be9b-3541686d1ed9" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-074510ab-ab2d-4326-be9b-3541686d1ed9" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab581b-bb7c-40b2-80b7-09e62b25f68f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:44 devstack sudo[113000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:44 devstack sudo[113000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:45 devstack sudo[113000]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 0.792s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:45 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9 Jun 23 14:17:45 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:45 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-074510ab-ab2d-4326-be9b-3541686d1ed9" returned: 0 in 0.680s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-074510ab-ab2d-4326-be9b-3541686d1ed9" released by "delete_volume" :: held 1.556s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Created reservations ['ead1d8c9-69d8-4f77-abc4-b59dca459cbd', '8749de00-d269-41a9-8082-fc7cefc85057', '0578ae2c-a079-4f14-a386-0af6bc1a6736', '0e698f5e-4a56-49c1-afd2-7e4085e80fd9'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:45 devstack sudo[113045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:17:45 devstack sudo[113045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-faf74707-2a67-4e48-a82d-ab744e10d36d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-faf74707-2a67-4e48-a82d-ab744e10d36d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "cinder-quobyte-faf74707-2a67-4e48-a82d-ab744e10d36d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-faf74707-2a67-4e48-a82d-ab744e10d36d" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[8804eec8-626b-4d7f-86b5-5c126d130ef8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:46 devstack sudo[113047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d Jun 23 14:17:46 devstack sudo[113047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:46 devstack sudo[113045]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.790s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Deleted volume successfully. Jun 23 14:17:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5a9f5bcd-2beb-4e3c-961c-39cf10b00644 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-074510ab-ab2d-4326-be9b-3541686d1ed9-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:47 devstack sudo[113047]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d" returned: 0 in 0.838s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:47 devstack sudo[113053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d Jun 23 14:17:47 devstack sudo[113053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:48 devstack sudo[113053]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-faf74707-2a67-4e48-a82d-ab744e10d36d" returned: 0 in 0.717s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-quobyte-faf74707-2a67-4e48-a82d-ab744e10d36d" released by "delete_volume" :: held 1.606s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Created reservations ['a034a4e5-1c40-48e5-986f-0e7a9c06b360', 'd20f03f5-d4c9-4729-bdb9-248c19f2fba5', '4a5ba7a8-586d-408b-a527-408e4ec69c72', 'f52aac31-027b-4f60-9a6a-a3575a9fc091'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:48 devstack sudo[113056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:17:48 devstack sudo[113056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:49 devstack sudo[113056]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.744s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:49 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:49 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Deleted volume successfully. Jun 23 14:17:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1f05b073-91cb-4af8-bc32-6f133752f197 tempest-SnapshotDependencyTests-904217876 None] Lock "cinder-faf74707-2a67-4e48-a82d-ab744e10d36d-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:17:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:17:51 devstack sudo[113062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:17:51 devstack sudo[113062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:17:52 devstack sudo[113062]: pam_unix(sudo:session): session closed for user root Jun 23 14:17:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.850s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:17:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:17:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:17:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:17:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:17:58 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=24,cinder:UPDATE=30,cinder:DELETE=1,cinder:INSERT=5 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:17:59 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=4 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (f646a867-b2e8-4856-9794-913887d3266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1193e26f-6e2e-474f-bda7-13536fdf2661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1193e26f-6e2e-474f-bda7-13536fdf2661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692342413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf98cbe7-a79f-4225-b67c-fc91e32d436c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:10Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099cf6a3-d8dc-4aae-99da-69837a1382d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099cf6a3-d8dc-4aae-99da-69837a1382d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764ea9d0-b925-42d7-ab85-9e0004d28e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764ea9d0-b925-42d7-ab85-9e0004d28e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf98cbe7-a79f-4225-b67c-fc91e32d436c', 'volume_name': 'volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6099f01-596e-4143-8cdd-e8c3a2da5e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6099f01-596e-4143-8cdd-e8c3a2da5e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161c655b-a128-4786-9c01-dcccd6d4872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:10 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Volume bf98cbe7-a79f-4225-b67c-fc91e32d436c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c', 'volume_size': 1} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692342413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf98cbe7-a79f-4225-b67c-fc91e32d436c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:10Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Creating volume bf98cbe7-a79f-4225-b67c-fc91e32d436c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:10 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:10 devstack sudo[113116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c 1073741824 Jun 23 14:18:10 devstack sudo[113116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (b8a179d3-4cd4-4481-a4c4-e644a36b1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:10 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fe034f-9dc2-48cf-ad0b-0db76f82b5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fe034f-9dc2-48cf-ad0b-0db76f82b5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194061673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef671d8d-b244-4a09-a673-e9f3771ced2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:11Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7254779-289f-4fd9-8251-a3c5e373a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7254779-289f-4fd9-8251-a3c5e373a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e5f08f-32b8-4ecc-8c4c-87c577bd9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e5f08f-32b8-4ecc-8c4c-87c577bd9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef671d8d-b244-4a09-a673-e9f3771ced2e', 'volume_name': 'volume-ef671d8d-b244-4a09-a673-e9f3771ced2e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51320786-2174-4700-a0cd-05478da8c193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51320786-2174-4700-a0cd-05478da8c193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07c387b-3e68-4daf-87be-c343e539b1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume ef671d8d-b244-4a09-a673-e9f3771ced2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef671d8d-b244-4a09-a673-e9f3771ced2e', 'volume_size': 1} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Flow 'volume_create_manager' (187a5d3c-a6f9-4e97-b985-7c2fbb4c2ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e546ec-c942-4d97-81fb-dfc3948a56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7e546ec-c942-4d97-81fb-dfc3948a56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a120fa-6ab5-4acb-8efe-d211a69f194c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c7f7df39674045b700c26556bbc1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='3acd2ac1ebe24727943f5b0bcf87a70c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f0d8a6-9ec4-47f3-9c3a-aaf60dcaad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f0d8a6-9ec4-47f3-9c3a-aaf60dcaad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35ae703-2474-4668-af19-b6d490f558ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35ae703-2474-4668-af19-b6d490f558ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a120fa-6ab5-4acb-8efe-d211a69f194c', 'volume_name': 'volume-99a120fa-6ab5-4acb-8efe-d211a69f194c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9c5367-6d38-476e-b747-5132e6e1cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9c5367-6d38-476e-b747-5132e6e1cccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703a1a39-05ee-413a-b47a-5f0df9f86fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Volume 99a120fa-6ab5-4acb-8efe-d211a69f194c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a120fa-6ab5-4acb-8efe-d211a69f194c', 'volume_size': 1} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (f053486a-59c3-43e5-889d-f383e28ecb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e3eebd-0186-4a47-b8f4-2c1be72628b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e3eebd-0186-4a47-b8f4-2c1be72628b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128572729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516e4c80-bf91-41c7-aadd-a4e0c4d56b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f97fc3f-e130-4e8a-99c8-c9ef2939d2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f97fc3f-e130-4e8a-99c8-c9ef2939d2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c53f7ce-b394-4e27-8176-a4abb702b61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c53f7ce-b394-4e27-8176-a4abb702b61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '516e4c80-bf91-41c7-aadd-a4e0c4d56b96', 'volume_name': 'volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d299d7-1eb4-4890-ac3b-05f4c9c3e3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d299d7-1eb4-4890-ac3b-05f4c9c3e3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9c63e9-13f2-41c6-9d61-a98c39e2f850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:11 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Volume 516e4c80-bf91-41c7-aadd-a4e0c4d56b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96', 'volume_size': 1} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:11 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (330f18ac-4242-47c9-adfb-2673963822a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c1b64-18b9-48b7-9f00-7cb97ee4986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c1b64-18b9-48b7-9f00-7cb97ee4986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433210878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e660d96-0547-4b76-92f9-c44d7cb78894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ed4128-3b7b-45e1-baf6-465597fa6eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ed4128-3b7b-45e1-baf6-465597fa6eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde051bf-9ad0-4a8d-a6bf-de60a5779757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde051bf-9ad0-4a8d-a6bf-de60a5779757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e660d96-0547-4b76-92f9-c44d7cb78894', 'volume_name': 'volume-3e660d96-0547-4b76-92f9-c44d7cb78894', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c688de-f421-445b-bdfb-3c31ea7a8845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c688de-f421-445b-bdfb-3c31ea7a8845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d644a33e-fd9a-40d6-8833-9a90a8ecd4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Volume 3e660d96-0547-4b76-92f9-c44d7cb78894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e660d96-0547-4b76-92f9-c44d7cb78894', 'volume_size': 1} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:12 devstack sudo[113116]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c 1073741824" returned: 0 in 1.516s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:12 devstack sudo[113123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c Jun 23 14:18:12 devstack sudo[113123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (7ab001d6-fb32-4829-81c7-c876908597dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6bd963-c48e-45b7-bd8c-e77c58d92369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6bd963-c48e-45b7-bd8c-e77c58d92369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1185154034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f6806-fd7d-4163-b864-66af4583de9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c8eba8-9a02-4f0b-b2d7-6c79d80a9203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c8eba8-9a02-4f0b-b2d7-6c79d80a9203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ffb1be-2114-49a6-abba-af550d388b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ffb1be-2114-49a6-abba-af550d388b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2f6806-fd7d-4163-b864-66af4583de9b', 'volume_name': 'volume-de2f6806-fd7d-4163-b864-66af4583de9b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bb9be1-6602-4533-8e3b-377fa146a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bb9be1-6602-4533-8e3b-377fa146a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c60bd0a-2762-4aec-8343-fc9a75cde5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:12 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Volume de2f6806-fd7d-4163-b864-66af4583de9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2f6806-fd7d-4163-b864-66af4583de9b', 'volume_size': 1} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:12 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:13 devstack sudo[113123]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (9a844224-0547-460e-b574-f0628aea02cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f743c980-56d7-450e-a376-a809c9861ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c" returned: 0 in 0.834s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1194061673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef671d8d-b244-4a09-a673-e9f3771ced2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:11Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Creating volume ef671d8d-b244-4a09-a673-e9f3771ced2e {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:13 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f743c980-56d7-450e-a376-a809c9861ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099629346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44714e5d-9b01-4409-b2e5-642c909cc9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:13Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064ba4a5-003e-4438-ae26-4022aab7b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:13 devstack sudo[113126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e 1073741824 Jun 23 14:18:13 devstack sudo[113126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064ba4a5-003e-4438-ae26-4022aab7b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e4030-1adf-4935-8ace-faa7d2d7bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e4030-1adf-4935-8ace-faa7d2d7bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44714e5d-9b01-4409-b2e5-642c909cc9d2', 'volume_name': 'volume-44714e5d-9b01-4409-b2e5-642c909cc9d2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310b30ce-5b33-449c-9cdb-5d8971e665cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310b30ce-5b33-449c-9cdb-5d8971e665cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef7557e-05d5-43aa-a321-3df0ce01f8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:13 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Volume 44714e5d-9b01-4409-b2e5-642c909cc9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44714e5d-9b01-4409-b2e5-642c909cc9d2', 'volume_size': 1} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161c655b-a128-4786-9c01-dcccd6d4872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec91739-74f1-45be-832e-4fe506be12c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:13 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Volume volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c (bf98cbe7-a79f-4225-b67c-fc91e32d436c): created successfully Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec91739-74f1-45be-832e-4fe506be12c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:13 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (f646a867-b2e8-4856-9794-913887d3266c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:13 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-83647516-8b4b-4eb5-a4c4-1f52b28afdd2 tempest-CreateVolumesFromImageTest-1556345579 None] Created volume successfully. Jun 23 14:18:14 devstack sudo[113126]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e 1073741824" returned: 0 in 0.955s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:14 devstack sudo[113132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e Jun 23 14:18:14 devstack sudo[113132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:14 devstack sudo[113132]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e" returned: 0 in 0.743s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.040s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a120fa-6ab5-4acb-8efe-d211a69f194c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c7f7df39674045b700c26556bbc1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='3acd2ac1ebe24727943f5b0bcf87a70c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Creating volume 99a120fa-6ab5-4acb-8efe-d211a69f194c {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:14 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:14 devstack sudo[113135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c 1073741824 Jun 23 14:18:14 devstack sudo[113135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07c387b-3e68-4daf-87be-c343e539b1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef671d8d-b244-4a09-a673-e9f3771ced2e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58a2656-4f69-4247-a55b-95439d0d9a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:14 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume volume-ef671d8d-b244-4a09-a673-e9f3771ced2e (ef671d8d-b244-4a09-a673-e9f3771ced2e): created successfully Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58a2656-4f69-4247-a55b-95439d0d9a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (b8a179d3-4cd4-4481-a4c4-e644a36b1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ef588cf2-2bd3-4028-bb38-c18c918152fa tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created volume successfully. Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Flow 'volume_create_manager' (1cda1e0e-2a92-41cd-a163-3418a2651dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbd01ce-e9c1-4722-b0be-2d0e9aee0d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbd01ce-e9c1-4722-b0be-2d0e9aee0d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2a48c9-132c-47f9-a969-de8b3c8545d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b41faaa8c4774b74a2966363d2e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:16Z,use_quota=True,user_id='f35747dca5204f54803b82fbab80eff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdf15f63-a27a-4bcd-bc5a-c83bc8b4b116),volume_type_id=bdf15f63-a27a-4bcd-bc5a-c83bc8b4b116)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89244ce2-1140-44a2-9406-e3eb3c3b594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89244ce2-1140-44a2-9406-e3eb3c3b594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da395b83-d271-4112-9048-b432edc0afef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:18:15 devstack sudo[113135]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c 1073741824" returned: 0 in 1.035s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:15 devstack sudo[113141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c Jun 23 14:18:15 devstack sudo[113141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da395b83-d271-4112-9048-b432edc0afef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f2a48c9-132c-47f9-a969-de8b3c8545d4', 'volume_name': 'volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4', 'volume_size': 1, 'image_id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4dc2db819062dd746570dc7f0964de4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '551b41faaa8c4774b74a2966363d2e34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '004d13134f32612b98a795ebc5e89d809450e2d59e56ffe1e9ff20f32133e0762cc4ca000a964956fd9ec2d1da6c19ba49cb91369edb8b3913c8e2e4d6949541', 'id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'created_at': datetime.datetime(2026, 6, 23, 12, 18, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 18, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567a2608-037c-47e8-bd21-ef256e87f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567a2608-037c-47e8-bd21-ef256e87f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eb7ed6-4d4b-4426-9f8d-bf3e200ad6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Volume 0f2a48c9-132c-47f9-a969-de8b3c8545d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4', 'volume_size': 1, 'image_id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4dc2db819062dd746570dc7f0964de4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '551b41faaa8c4774b74a2966363d2e34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '004d13134f32612b98a795ebc5e89d809450e2d59e56ffe1e9ff20f32133e0762cc4ca000a964956fd9ec2d1da6c19ba49cb91369edb8b3913c8e2e4d6949541', 'id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'created_at': datetime.datetime(2026, 6, 23, 12, 18, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 18, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Trying to clone 0f2a48c9-132c-47f9-a969-de8b3c8545d4 from image a1b08447-2e79-487e-b6d3-a8f71b8690d6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (defc69c6-d74d-4e66-b00e-d2f8469ca865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e51f4-1b91-43d9-8f28-590cf86da4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e51f4-1b91-43d9-8f28-590cf86da4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-200348223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6efff8-8222-49ca-97a6-ce7e36753492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:16Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11683f64-7363-4ed1-aed0-b013d7eee57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11683f64-7363-4ed1-aed0-b013d7eee57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e000ede-d178-407d-9f05-f679ab52cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e000ede-d178-407d-9f05-f679ab52cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6efff8-8222-49ca-97a6-ce7e36753492', 'volume_name': 'volume-5a6efff8-8222-49ca-97a6-ce7e36753492', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3d9c0e-8b7b-4105-8367-7447152b42a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3d9c0e-8b7b-4105-8367-7447152b42a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed77d0d-25e5-476c-a392-2c8528957ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume 5a6efff8-8222-49ca-97a6-ce7e36753492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6efff8-8222-49ca-97a6-ce7e36753492', 'volume_size': 1} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:18:16 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702b1ac-89ee-4669-9eca-485b4e10fbd6]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:16 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD Jun 23 14:18:16 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (0cfbb1bd-83d2-488e-8015-5674005ab3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaaaf32-d685-4c83-89d7-10ee54084faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eaaaf32-d685-4c83-89d7-10ee54084faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1201664510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156cc8b0-b15d-4d65-a463-357478347711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:17Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a28b39-b99c-4027-a8ab-d5ebf1dd4935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a28b39-b99c-4027-a8ab-d5ebf1dd4935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72399e7d-33c1-4166-8bc4-7f4ba28f64a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72399e7d-33c1-4166-8bc4-7f4ba28f64a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '156cc8b0-b15d-4d65-a463-357478347711', 'volume_name': 'volume-156cc8b0-b15d-4d65-a463-357478347711', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack sudo[113141]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a8bff2-0a30-4961-9ff9-4646fb189144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a8bff2-0a30-4961-9ff9-4646fb189144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a591525-7e2c-406c-bcf8-560c9e323bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume 156cc8b0-b15d-4d65-a463-357478347711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-156cc8b0-b15d-4d65-a463-357478347711', 'volume_size': 1} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c" returned: 0 in 1.034s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.055s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128572729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=516e4c80-bf91-41c7-aadd-a4e0c4d56b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Creating volume 516e4c80-bf91-41c7-aadd-a4e0c4d56b96 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:16 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703a1a39-05ee-413a-b47a-5f0df9f86fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a120fa-6ab5-4acb-8efe-d211a69f194c', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack sudo[113146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 1073741824 Jun 23 14:18:17 devstack sudo[113146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acea29b8-b303-4b6a-bded-c40e17150f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Volume volume-99a120fa-6ab5-4acb-8efe-d211a69f194c (99a120fa-6ab5-4acb-8efe-d211a69f194c): created successfully Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acea29b8-b303-4b6a-bded-c40e17150f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Flow 'volume_create_manager' (187a5d3c-a6f9-4e97-b985-7c2fbb4c2ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-031601d7-1f8d-4249-8490-528a14adc5a4 tempest-CinderUnicodeTest-906946386 None] Created volume successfully. Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (51131039-845f-4902-ba09-afff6ef0b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f8c507-0e5a-4c31-9c37-0a3e25885837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f8c507-0e5a-4c31-9c37-0a3e25885837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909154409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911b5df8-ba1e-4d83-89fd-2d56e2704ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:17Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1554b65-e385-4f46-8ba9-876035c36178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1554b65-e385-4f46-8ba9-876035c36178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2beb9f49-1e3d-4755-b2fe-335e689afa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2beb9f49-1e3d-4755-b2fe-335e689afa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911b5df8-ba1e-4d83-89fd-2d56e2704ccd', 'volume_name': 'volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e94b851-2e36-485e-9ffe-a9d97178ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e94b851-2e36-485e-9ffe-a9d97178ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429e4a23-78ae-4c98-a823-d7a8debdd43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume 911b5df8-ba1e-4d83-89fd-2d56e2704ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd', 'volume_size': 1} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:17 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD" returned: 0 in 1.108s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:17 devstack sudo[113150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD Jun 23 14:18:17 devstack sudo[113150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (fa91e3f7-4ab3-4ca1-92c7-065ea4a136d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d284db-59ef-40ad-a408-131de4902bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d284db-59ef-40ad-a408-131de4902bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905228886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3bdf0c-080d-436e-9de0-846ed26ee601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:18Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e640850e-3d79-4426-a099-510be1d75f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e640850e-3d79-4426-a099-510be1d75f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67177847-d837-4d5a-8b71-590acbb32077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67177847-d837-4d5a-8b71-590acbb32077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3bdf0c-080d-436e-9de0-846ed26ee601', 'volume_name': 'volume-aa3bdf0c-080d-436e-9de0-846ed26ee601', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d611ea-05f8-4ef2-bd80-7e51394888cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d611ea-05f8-4ef2-bd80-7e51394888cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504358c5-bff8-449d-8f61-1012d9952004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume aa3bdf0c-080d-436e-9de0-846ed26ee601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3bdf0c-080d-436e-9de0-846ed26ee601', 'volume_size': 1} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:18 devstack sudo[113146]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 1073741824" returned: 0 in 1.408s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:18 devstack sudo[113156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 Jun 23 14:18:18 devstack sudo[113156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:18 devstack sudo[113150]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD" returned: 1 in 1.151s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Temporary image a1b08447-2e79-487e-b6d3-a8f71b8690d6 is fetched for user f35747dca5204f54803b82fbab80eff9. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (7eaa468d-b2fc-4327-92a0-5196b3a99530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d0e8bb-5340-4ca0-adad-57aaea6f968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d0e8bb-5340-4ca0-adad-57aaea6f968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1195945057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ace641-6d9a-4990-b42e-09e4a3f33510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:19Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45dc4e-8c6e-4f93-99c1-f302774bf52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d45dc4e-8c6e-4f93-99c1-f302774bf52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb80af-a3e2-40cb-b2d0-6c311afe88f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb80af-a3e2-40cb-b2d0-6c311afe88f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ace641-6d9a-4990-b42e-09e4a3f33510', 'volume_name': 'volume-12ace641-6d9a-4990-b42e-09e4a3f33510', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca041aac-16df-4f65-8524-8d0ee571737a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca041aac-16df-4f65-8524-8d0ee571737a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74851423-3f01-46f6-bb06-8d198c305666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume 12ace641-6d9a-4990-b42e-09e4a3f33510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ace641-6d9a-4990-b42e-09e4a3f33510', 'volume_size': 1} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Flow 'volume_create_manager' (b3463188-325d-4012-bd2b-db80a1153f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac6e5b1-e487-41ac-a8ac-dc7ff266f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac6e5b1-e487-41ac-a8ac-dc7ff266f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-416476570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7834e2f5-43b7-4d4f-b8eb-1009f0a3e754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c7f7df39674045b700c26556bbc1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:19Z,use_quota=True,user_id='3acd2ac1ebe24727943f5b0bcf87a70c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118f3b90-e8d3-495e-bf3d-eb3f136603a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118f3b90-e8d3-495e-bf3d-eb3f136603a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d971b8-d535-4b65-a009-f956e1d1eec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d971b8-d535-4b65-a009-f956e1d1eec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7834e2f5-43b7-4d4f-b8eb-1009f0a3e754', 'volume_name': 'volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00b3eac-ee31-4a7e-8f40-5f625acceab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00b3eac-ee31-4a7e-8f40-5f625acceab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f856c1-7358-4ad6-b0c7-9f50652af834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:18 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Volume 7834e2f5-43b7-4d4f-b8eb-1009f0a3e754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754', 'volume_size': 1} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f710cf6-03f9-4ee9-aa48-0eda9e86f7fa]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:19 devstack sudo[113161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD Jun 23 14:18:19 devstack sudo[113161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:19 devstack sudo[113156]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96" returned: 0 in 0.767s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.145s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433210878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e660d96-0547-4b76-92f9-c44d7cb78894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Creating volume 3e660d96-0547-4b76-92f9-c44d7cb78894 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:19 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:19 devstack sudo[113164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 1073741824 Jun 23 14:18:19 devstack sudo[113164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9c63e9-13f2-41c6-9d61-a98c39e2f850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0274bd34-67e3-48de-8b31-90684925428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:19 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Volume volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 (516e4c80-bf91-41c7-aadd-a4e0c4d56b96): created successfully Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0274bd34-67e3-48de-8b31-90684925428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (f053486a-59c3-43e5-889d-f383e28ecb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:19 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-90f64eb6-dd1b-441d-82a6-ea85b39bb93c tempest-CreateVolumesFromImageTest-1556345579 None] Created volume successfully. Jun 23 14:18:19 devstack sudo[113161]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:19 devstack sudo[113168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD Jun 23 14:18:19 devstack sudo[113168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:20 devstack sudo[113164]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 1073741824" returned: 0 in 0.917s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:20 devstack sudo[113173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 Jun 23 14:18:20 devstack sudo[113173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:20 devstack sudo[113168]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:20 devstack sudo[113173]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894" returned: 0 in 0.719s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.216s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1185154034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f6806-fd7d-4163-b864-66af4583de9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:12Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Creating volume de2f6806-fd7d-4163-b864-66af4583de9b {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:20 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d644a33e-fd9a-40d6-8833-9a90a8ecd4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e660d96-0547-4b76-92f9-c44d7cb78894', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:20 devstack sudo[113179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b 1073741824 Jun 23 14:18:20 devstack sudo[113179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aabddd6-0738-4d9a-b2fe-dd3385c3ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:20 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Volume volume-3e660d96-0547-4b76-92f9-c44d7cb78894 (3e660d96-0547-4b76-92f9-c44d7cb78894): created successfully Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aabddd6-0738-4d9a-b2fe-dd3385c3ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (330f18ac-4242-47c9-adfb-2673963822a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:20 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8ba243ae-dd8a-4491-b0bf-27244ba5edcd tempest-CreateVolumesFromImageTest-1556345579 None] Created volume successfully. Jun 23 14:18:21 devstack sudo[113179]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b 1073741824" returned: 0 in 0.858s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:21 devstack sudo[113185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b Jun 23 14:18:21 devstack sudo[113185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:22 devstack sudo[113185]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b" returned: 0 in 0.641s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.276s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1099629346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44714e5d-9b01-4409-b2e5-642c909cc9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352374218d3d4d5cae8558eada1ba2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:13Z,use_quota=True,user_id='a0c3ee3ce4e045e29c090412735caba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Creating volume 44714e5d-9b01-4409-b2e5-642c909cc9d2 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:22 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c60bd0a-2762-4aec-8343-fc9a75cde5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2f6806-fd7d-4163-b864-66af4583de9b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:22 devstack sudo[113188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 1073741824 Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce65990-c1b8-4636-8be2-0de742e54cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:22 devstack sudo[113188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:22 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Volume volume-de2f6806-fd7d-4163-b864-66af4583de9b (de2f6806-fd7d-4163-b864-66af4583de9b): created successfully Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce65990-c1b8-4636-8be2-0de742e54cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (7ab001d6-fb32-4829-81c7-c876908597dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:22 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-036f30db-e3ec-4a73-937a-aa670ae45030 tempest-CreateVolumesFromImageTest-1556345579 None] Created volume successfully. Jun 23 14:18:23 devstack sudo[113188]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 1073741824" returned: 0 in 0.928s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:23 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 Jun 23 14:18:23 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:24 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2" returned: 0 in 0.732s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.882s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-200348223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6efff8-8222-49ca-97a6-ce7e36753492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:16Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Creating volume 5a6efff8-8222-49ca-97a6-ce7e36753492 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:24 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:24 devstack sudo[113198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 1073741824 Jun 23 14:18:24 devstack sudo[113198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef7557e-05d5-43aa-a321-3df0ce01f8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44714e5d-9b01-4409-b2e5-642c909cc9d2', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b0a3f-0753-472e-a89b-7650fc3e410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:24 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Volume volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 (44714e5d-9b01-4409-b2e5-642c909cc9d2): created successfully Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7b0a3f-0753-472e-a89b-7650fc3e410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Flow 'volume_create_manager' (9a844224-0547-460e-b574-f0628aea02cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-74982d72-0dd4-4547-80fa-7f46451749e5 tempest-CreateVolumesFromImageTest-1556345579 None] Created volume successfully. Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-44714e5d-9b01-4409-b2e5-642c909cc9d2-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:25 devstack sudo[113198]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 1073741824" returned: 0 in 0.889s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-44714e5d-9b01-4409-b2e5-642c909cc9d2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-quobyte-44714e5d-9b01-4409-b2e5-642c909cc9d2" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:25 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 Jun 23 14:18:25 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-44714e5d-9b01-4409-b2e5-642c909cc9d2" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[183cac3c-4412-4868-a4bf-ec039b2071d5]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:25 devstack sudo[113205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 Jun 23 14:18:25 devstack sudo[113205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:25 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492" returned: 0 in 0.668s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.819s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1201664510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156cc8b0-b15d-4d65-a463-357478347711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:17Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Creating volume 156cc8b0-b15d-4d65-a463-357478347711 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:25 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:25 devstack sudo[113208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 1073741824 Jun 23 14:18:25 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed77d0d-25e5-476c-a392-2c8528957ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6efff8-8222-49ca-97a6-ce7e36753492', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c483507-8e3d-429c-8105-1689c05bb61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume volume-5a6efff8-8222-49ca-97a6-ce7e36753492 (5a6efff8-8222-49ca-97a6-ce7e36753492): created successfully Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c483507-8e3d-429c-8105-1689c05bb61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (defc69c6-d74d-4e66-b00e-d2f8469ca865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:25 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-2a3d99b5-7b33-4d4d-ba90-52261ea257a0 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created volume successfully. Jun 23 14:18:26 devstack sudo[113205]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2" returned: 0 in 0.879s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:26 devstack sudo[113213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2 Jun 23 14:18:26 devstack sudo[113213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:26 devstack sudo[113213]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-44714e5d-9b01-4409-b2e5-642c909cc9d2" returned: 0 in 0.686s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-44714e5d-9b01-4409-b2e5-642c909cc9d2" released by "delete_volume" :: held 1.622s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:26 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 1073741824" returned: 0 in 0.994s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Created reservations ['f9d9027b-636a-4f10-bbdd-e5be2717229c', '33c4e7d5-3527-4540-98f2-f6a0d435fc26', '824cc47e-1fed-4eba-a16e-f538d3f97019', '9c988f8d-713a-41de-af5b-f8e21040199d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:26 devstack sudo[113220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 Jun 23 14:18:26 devstack sudo[113220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:27 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:27 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-de2f6806-fd7d-4163-b864-66af4583de9b-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-de2f6806-fd7d-4163-b864-66af4583de9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-quobyte-de2f6806-fd7d-4163-b864-66af4583de9b" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-de2f6806-fd7d-4163-b864-66af4583de9b" acquired by "delete_volume" :: waited 0.015s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dba5c1-023b-4328-9484-00f87cfff719]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:27 devstack sudo[113224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b Jun 23 14:18:27 devstack sudo[113224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:27 devstack sudo[113220]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711" returned: 0 in 0.840s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.294s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909154409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911b5df8-ba1e-4d83-89fd-2d56e2704ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:17Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Creating volume 911b5df8-ba1e-4d83-89fd-2d56e2704ccd {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:27 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:27 devstack sudo[113228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd 1073741824 Jun 23 14:18:27 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a591525-7e2c-406c-bcf8-560c9e323bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-156cc8b0-b15d-4d65-a463-357478347711', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b15e3b2-3210-4a60-9f33-8e81fe8836f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:27 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.818s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:27 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume volume-156cc8b0-b15d-4d65-a463-357478347711 (156cc8b0-b15d-4d65-a463-357478347711): created successfully Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b15e3b2-3210-4a60-9f33-8e81fe8836f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (0cfbb1bd-83d2-488e-8015-5674005ab3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Deleted volume successfully. Jun 23 14:18:27 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8c508901-b063-41b6-aead-cf2d65f66583 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created volume successfully. Jun 23 14:18:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-b70a22cf-7b3c-4b32-8ab4-4a7cec7f3721 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-44714e5d-9b01-4409-b2e5-642c909cc9d2-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:28 devstack sudo[113224]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b" returned: 0 in 0.890s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:28 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b Jun 23 14:18:28 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:28 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd 1073741824" returned: 0 in 1.001s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:28 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd Jun 23 14:18:28 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:29 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-de2f6806-fd7d-4163-b864-66af4583de9b" returned: 0 in 0.738s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-de2f6806-fd7d-4163-b864-66af4583de9b" released by "delete_volume" :: held 1.710s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Created reservations ['5429a114-d70f-44f0-8649-756958109982', 'e5ed86ef-325d-4f54-89e1-d7a578e9e413', 'b66fa54a-f9e3-4875-a024-3f4e0962cd0e', 'f48fa1a2-efcf-44b0-9d89-e581060229ab'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:29 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:29 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:29 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-3e660d96-0547-4b76-92f9-c44d7cb78894-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd" returned: 0 in 0.855s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.623s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905228886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3bdf0c-080d-436e-9de0-846ed26ee601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:18Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Creating volume aa3bdf0c-080d-436e-9de0-846ed26ee601 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:29 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-3e660d96-0547-4b76-92f9-c44d7cb78894-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:29 devstack sudo[113244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 1073741824 Jun 23 14:18:29 devstack sudo[113244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429e4a23-78ae-4c98-a823-d7a8debdd43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02df4f2-3b10-451f-8a69-8a893b937365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:29 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd (911b5df8-ba1e-4d83-89fd-2d56e2704ccd): created successfully Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02df4f2-3b10-451f-8a69-8a893b937365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (51131039-845f-4902-ba09-afff6ef0b889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-quobyte-3e660d96-0547-4b76-92f9-c44d7cb78894" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e8ae406a-be61-4426-815c-3c821f7428ad tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created volume successfully. Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-3e660d96-0547-4b76-92f9-c44d7cb78894" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9da328c-2b3e-4f97-a476-fecabf9250a4]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:29 devstack sudo[113246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 Jun 23 14:18:29 devstack sudo[113246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:30 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.780s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:30 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Deleted volume successfully. Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-77f46e06-75a4-495b-80ce-e5c57d6502ea tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-de2f6806-fd7d-4163-b864-66af4583de9b-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:30 devstack sudo[113244]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 1073741824" returned: 0 in 1.033s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:30 devstack sudo[113255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 Jun 23 14:18:30 devstack sudo[113255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:30 devstack sudo[113246]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894" returned: 0 in 0.970s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:30 devstack sudo[113257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894 Jun 23 14:18:30 devstack sudo[113257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:31 devstack sudo[113255]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601" returned: 0 in 0.776s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.702s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1195945057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ace641-6d9a-4990-b42e-09e4a3f33510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67652cf40ab848a6a9a0ac32f79b0e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:19Z,use_quota=True,user_id='7e6e98c64f654c7686282e6eee48b640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Creating volume 12ace641-6d9a-4990-b42e-09e4a3f33510 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:31 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:31 devstack sudo[113261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 1073741824 Jun 23 14:18:31 devstack sudo[113261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504358c5-bff8-449d-8f61-1012d9952004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3bdf0c-080d-436e-9de0-846ed26ee601', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af815ea5-6264-406a-ba98-55f333cba0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:31 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 (aa3bdf0c-080d-436e-9de0-846ed26ee601): created successfully Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af815ea5-6264-406a-ba98-55f333cba0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (fa91e3f7-4ab3-4ca1-92c7-065ea4a136d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:31 devstack sudo[113257]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-3e660d96-0547-4b76-92f9-c44d7cb78894" returned: 0 in 0.825s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:31 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7fb8fb71-8dbd-4a95-a835-a6e18be46044 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created volume successfully. Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-3e660d96-0547-4b76-92f9-c44d7cb78894" released by "delete_volume" :: held 1.850s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Created reservations ['56a5caf7-15dc-44a5-88f7-663c4a7f1da7', '670b2666-4bd3-4a96-9082-237d3183c21c', 'e357ed53-e1dc-42ec-976a-13b965389882', 'a130227a-c517-478f-ad50-ce18700e3d3d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:31 devstack sudo[113263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:31 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-516e4c80-bf91-41c7-aadd-a4e0c4d56b96-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-516e4c80-bf91-41c7-aadd-a4e0c4d56b96-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-quobyte-516e4c80-bf91-41c7-aadd-a4e0c4d56b96" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-516e4c80-bf91-41c7-aadd-a4e0c4d56b96" acquired by "delete_volume" :: waited 0.025s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40c510-503b-4a1d-8f03-4d233681633a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:32 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 Jun 23 14:18:32 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:32 devstack sudo[113261]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 1073741824" returned: 0 in 1.085s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:32 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 Jun 23 14:18:32 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:32 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.966s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Deleted volume successfully. Jun 23 14:18:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c80ecb28-9c03-4565-8e74-507648c5daa3 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-3e660d96-0547-4b76-92f9-c44d7cb78894-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:33 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96" returned: 0 in 0.932s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:33 devstack sudo[113276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96 Jun 23 14:18:33 devstack sudo[113276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:33 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510" returned: 0 in 0.810s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.573s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-416476570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7834e2f5-43b7-4d4f-b8eb-1009f0a3e754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75c7f7df39674045b700c26556bbc1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:19Z,use_quota=True,user_id='3acd2ac1ebe24727943f5b0bcf87a70c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Creating volume 7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:33 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:33 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 1073741824 Jun 23 14:18:33 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74851423-3f01-46f6-bb06-8d198c305666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ace641-6d9a-4990-b42e-09e4a3f33510', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024894db-de41-4b62-8222-e62028833f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:33 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Volume volume-12ace641-6d9a-4990-b42e-09e4a3f33510 (12ace641-6d9a-4990-b42e-09e4a3f33510): created successfully Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024894db-de41-4b62-8222-e62028833f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Flow 'volume_create_manager' (7eaa468d-b2fc-4327-92a0-5196b3a99530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:33 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-de212507-ddb0-4e0b-ac73-11a5adbcbbb9 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created volume successfully. Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-12ace641-6d9a-4990-b42e-09e4a3f33510-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:33 devstack sudo[113276]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-516e4c80-bf91-41c7-aadd-a4e0c4d56b96" returned: 0 in 0.775s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-12ace641-6d9a-4990-b42e-09e4a3f33510-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-516e4c80-bf91-41c7-aadd-a4e0c4d56b96" released by "delete_volume" :: held 1.773s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-quobyte-12ace641-6d9a-4990-b42e-09e4a3f33510" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-12ace641-6d9a-4990-b42e-09e4a3f33510" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c305b32c-8aa3-48f1-b0b1-014f783afcb6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:33 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Created reservations ['f2644cca-2cef-4393-a0ab-2230117fa91f', '0b3cb221-576c-43eb-a2ec-1218dae61d25', 'b631ce33-dcd4-4322-b765-b4e13cca404c', '8a186b01-a5e6-4d6c-8b57-dcf13766f786'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:34 devstack sudo[113284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 Jun 23 14:18:34 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:34 devstack sudo[113284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:34 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-bf98cbe7-a79f-4225-b67c-fc91e32d436c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-bf98cbe7-a79f-4225-b67c-fc91e32d436c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "cinder-quobyte-bf98cbe7-a79f-4225-b67c-fc91e32d436c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-bf98cbe7-a79f-4225-b67c-fc91e32d436c" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e4b93c-ea4c-4f64-88ba-74c2129072fb]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:34 devstack sudo[113292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c Jun 23 14:18:34 devstack sudo[113292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:34 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 1073741824" returned: 0 in 1.135s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:34 devstack sudo[113294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 Jun 23 14:18:34 devstack sudo[113294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:35 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.000s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Deleted volume successfully. Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-a98b0d20-f933-4aed-bfd8-c74df7c125d9 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-516e4c80-bf91-41c7-aadd-a4e0c4d56b96-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:35 devstack sudo[113284]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510" returned: 0 in 1.195s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:35 devstack sudo[113301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510 Jun 23 14:18:35 devstack sudo[113301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:35 devstack sudo[113292]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c" returned: 0 in 1.125s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:35 devstack sudo[113307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c Jun 23 14:18:35 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:35 devstack sudo[113294]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" returned: 0 in 0.839s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.110s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2a48c9-132c-47f9-a969-de8b3c8545d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551b41faaa8c4774b74a2966363d2e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:16Z,use_quota=True,user_id='f35747dca5204f54803b82fbab80eff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdf15f63-a27a-4bcd-bc5a-c83bc8b4b116),volume_type_id=bdf15f63-a27a-4bcd-bc5a-c83bc8b4b116)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Creating volume 0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:35 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f856c1-7358-4ad6-b0c7-9f50652af834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bcaf2b-6e49-45c1-8f82-d6c8ab7aa279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:35 devstack sudo[113309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 1073741824 Jun 23 14:18:35 devstack sudo[113309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:35 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Volume volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 (7834e2f5-43b7-4d4f-b8eb-1009f0a3e754): created successfully Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bcaf2b-6e49-45c1-8f82-d6c8ab7aa279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Flow 'volume_create_manager' (b3463188-325d-4012-bd2b-db80a1153f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:35 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9a179dd4-c4f2-4015-b938-1a54fa330f32 tempest-CinderUnicodeTest-906946386 None] Created volume successfully. Jun 23 14:18:35 devstack sudo[113301]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-12ace641-6d9a-4990-b42e-09e4a3f33510" returned: 0 in 0.764s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-12ace641-6d9a-4990-b42e-09e4a3f33510" released by "delete_volume" :: held 2.025s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created reservations ['12602f70-e2cc-4f44-8cdd-d063a89e0ae4', '0055cdca-65f3-4c47-ac2e-3de639c32d43', 'e567b75f-512f-4139-af89-7d2f6c37a9bb', '7d15720c-a7ae-44af-a427-63d67634edee'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:36 devstack sudo[113312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:36 devstack sudo[113312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:36 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf98cbe7-a79f-4225-b67c-fc91e32d436c" returned: 0 in 0.950s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-quobyte-bf98cbe7-a79f-4225-b67c-fc91e32d436c" released by "delete_volume" :: held 2.129s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Created reservations ['1fd6d3f2-c91a-43e8-984f-03bedd5fab0b', 'b809f4cd-fa3c-4810-9f00-371961da294f', '8dbc3bc9-69f9-4ee4-9029-13bcec3bd3cf', '5ecf7a8b-b7db-4121-ba2e-b927ea4a74cc'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:36 devstack sudo[113319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:36 devstack sudo[113319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:36 devstack sudo[113309]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 1073741824" returned: 0 in 1.276s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:36 devstack sudo[113312]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.847s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:36 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:36 devstack sudo[113322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:36 devstack sudo[113322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:36 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Deleted volume successfully. Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-525d3530-6d71-405a-8696-2b8e76b04768 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-12ace641-6d9a-4990-b42e-09e4a3f33510-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-aa3bdf0c-080d-436e-9de0-846ed26ee601-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-aa3bdf0c-080d-436e-9de0-846ed26ee601-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-quobyte-aa3bdf0c-080d-436e-9de0-846ed26ee601" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:37 devstack sudo[113319]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.726s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-aa3bdf0c-080d-436e-9de0-846ed26ee601" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:37 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Deleted volume successfully. Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[397acb58-9a35-415c-b85d-cd1117e3d836]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-1cc050cb-e9b9-422c-8f58-945f98460fd5 tempest-CreateVolumesFromImageTest-1556345579 None] Lock "cinder-bf98cbe7-a79f-4225-b67c-fc91e32d436c-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:37 devstack sudo[113325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 Jun 23 14:18:37 devstack sudo[113325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:37 devstack sudo[113322]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 0 in 0.773s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.361s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Creating offline snapshot 3f8d8c82-e6bf-4966-b10a-52e36d8f1add of volume 7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Attempting download of a1b08447-2e79-487e-b6d3-a8f71b8690d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'metadata': {}}])) to volume 0f2a48c9-132c-47f9-a969-de8b3c8545d4. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f3809-38d7-445e-901f-9877269ef442]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[38516fd3-dd80-4f2b-baa0-1e94ac7ee190]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:37 devstack sudo[113328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 Jun 23 14:18:37 devstack sudo[113328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:37 devstack sudo[113329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv Jun 23 14:18:37 devstack sudo[113329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:38 devstack sudo[113325]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601" returned: 0 in 1.083s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:38 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601 Jun 23 14:18:38 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:38 devstack sudo[113329]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv" returned: 0 in 1.060s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:38 devstack sudo[113328]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" returned: 0 in 1.152s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:38 devstack sudo[113344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add 1G Jun 23 14:18:38 devstack sudo[113344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:39 devstack sudo[113343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv Jun 23 14:18:39 devstack sudo[113343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:39 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-aa3bdf0c-080d-436e-9de0-846ed26ee601" returned: 0 in 1.135s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-aa3bdf0c-080d-436e-9de0-846ed26ee601" released by "delete_volume" :: held 2.282s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created reservations ['dd4e1cee-066d-4675-a29d-bf0bbbe57484', '7901eb19-c2ee-44ab-a42b-491fbd3c4329', 'd927cf52-8d37-4420-8d93-46480476a18c', '3b7dcedc-7877-4dc0-9008-1d239886f0be'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:39 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:39 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:39 devstack sudo[113343]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv" returned: 1 in 1.062s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a1b08447-2e79-487e-b6d3-a8f71b8690d6__lmk5pzv' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7095fe-ec4d-4c96-bdf5-0c40a734203b]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:39 devstack sudo[113344]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add 1G" returned: 0 in 1.058s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:39 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:40 devstack sudo[113357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add Jun 23 14:18:40 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:40 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD Jun 23 14:18:40 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:40 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.759s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:40 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Deleted volume successfully. Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-4e48183b-6acd-445e-8334-b55c458a6f8a tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-aa3bdf0c-080d-436e-9de0-846ed26ee601-delete_volume" released by "delete_volume" :: held 3.387s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-911b5df8-ba1e-4d83-89fd-2d56e2704ccd-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-911b5df8-ba1e-4d83-89fd-2d56e2704ccd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-quobyte-911b5df8-ba1e-4d83-89fd-2d56e2704ccd" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-911b5df8-ba1e-4d83-89fd-2d56e2704ccd" acquired by "delete_volume" :: waited 0.014s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5384da-1574-4c20-b093-413d41d2d22c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:40 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add" returned: 0 in 0.960s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:40 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add is being set with open permissions: ugo+rw Jun 23 14:18:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:40 devstack sudo[113367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add Jun 23 14:18:40 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:41 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:41 devstack sudo[113364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD" returned: 0 in 1.064s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:41 devstack sudo[113364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:41 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD Jun 23 14:18:41 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Flow 'volume_create_manager' (f1ef4bac-0970-42b0-82ef-8674ab60268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745950a3-4389-469a-b0c5-cb137718c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745950a3-4389-469a-b0c5-cb137718c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540771323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9397aa9-26aa-43ae-8719-b1c93ce1fb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0076b5def6c241f98c040e29ffc99080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:42Z,use_quota=True,user_id='4ad33428000b47adbc2c12507a563cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd87c4e-83e6-4cd8-a1a8-2ce090f01212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd87c4e-83e6-4cd8-a1a8-2ce090f01212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b66c8b6-6ca2-46e9-ad47-8eaa9010282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b66c8b6-6ca2-46e9-ad47-8eaa9010282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9397aa9-26aa-43ae-8719-b1c93ce1fb6e', 'volume_name': 'volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad75f32-8db5-4655-9616-c52d626ccc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad75f32-8db5-4655-9616-c52d626ccc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358e115-1ae5-4a9d-83a3-6d6ae199bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:41 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Volume b9397aa9-26aa-43ae-8719-b1c93ce1fb6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e', 'volume_size': 1} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:41 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add" returned: 0 in 0.865s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:41 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info Jun 23 14:18:41 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:41 devstack sudo[113364]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd" returned: 0 in 1.065s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:41 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:41 devstack sudo[113381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd Jun 23 14:18:41 devstack sudo[113381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:42 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD" returned: 1 in 0.987s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] a1b08447-2e79-487e-b6d3-a8f71b8690d6 was raw, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:42 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:42 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:42 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info" returned: 0 in 0.695s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:42 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info is being set with open permissions: ugo+rw Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:42 devstack sudo[113387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info Jun 23 14:18:42 devstack sudo[113387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:42 devstack sudo[113381]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-911b5df8-ba1e-4d83-89fd-2d56e2704ccd" returned: 0 in 0.722s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-911b5df8-ba1e-4d83-89fd-2d56e2704ccd" released by "delete_volume" :: held 1.853s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created reservations ['0ed12e57-7940-477c-b353-7fdcf0f56b09', '71cd8e52-dba1-4b1e-8160-d47d5d440521', '54e63498-5711-4c4a-af12-24af93cbdb83', '344e877f-4fa5-4d28-a764-abe705b1ad3e'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:42 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:42 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-156cc8b0-b15d-4d65-a463-357478347711-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-156cc8b0-b15d-4d65-a463-357478347711-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:43 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 0 in 1.074s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a1b08447-2e79-487e-b6d3-a8f71b8690d6_0tfft3uidevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:18:43 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:43 devstack sudo[113394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 1G Jun 23 14:18:43 devstack sudo[113394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-quobyte-156cc8b0-b15d-4d65-a463-357478347711" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-156cc8b0-b15d-4d65-a463-357478347711" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d1640-a6de-492c-a187-c71984f260f8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:43 devstack sudo[113387]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.info" returned: 0 in 0.738s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.597s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540771323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9397aa9-26aa-43ae-8719-b1c93ce1fb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0076b5def6c241f98c040e29ffc99080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:42Z,use_quota=True,user_id='4ad33428000b47adbc2c12507a563cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Creating volume b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:43 devstack sudo[113397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 Jun 23 14:18:43 devstack sudo[113397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:43 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:43 devstack sudo[113399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e 1073741824 Jun 23 14:18:43 devstack sudo[113399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-bb123bda-24e4-4888-b700-dabe05f28165 tempest-CinderUnicodeTest-906946386 None] Create snapshot completed successfully Jun 23 14:18:43 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.802s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:43 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Deleted volume successfully. Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5861d8f6-c9fb-4865-99cc-df538adb71e2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-911b5df8-ba1e-4d83-89fd-2d56e2704ccd-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-3f8d8c82-e6bf-4966-b10a-52e36d8f1add-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Lock "cinder-3f8d8c82-e6bf-4966-b10a-52e36d8f1add-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-quobyte-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-quobyte-3f8d8c82-e6bf-4966-b10a-52e36d8f1add" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-3f8d8c82-e6bf-4966-b10a-52e36d8f1add" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:43 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Deleting offline snapshot 3f8d8c82-e6bf-4966-b10a-52e36d8f1add of volume 7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] snapshot_file for this snap is: volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f4b2d0-5eab-412e-93d3-cd4187a1ae73]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:44 devstack sudo[113394]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 1G" returned: 0 in 0.982s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4239b71-600b-4328-831d-62f0ce0543db]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:44 devstack sudo[113408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add Jun 23 14:18:44 devstack sudo[113408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:44 devstack sudo[113397]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711" returned: 0 in 1.006s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:44 devstack sudo[113415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711 Jun 23 14:18:44 devstack sudo[113415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:44 devstack sudo[113413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:44 devstack sudo[113413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:44 devstack sudo[113399]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e 1073741824" returned: 0 in 1.086s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:44 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:18:44 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:44 devstack sudo[113408]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add" returned: 0 in 0.880s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:18:44 devstack sudo[113413]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 0 in 0.826s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de8e79f-af41-412e-983e-d63428a35f83]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:45 devstack sudo[113433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 Jun 23 14:18:45 devstack sudo[113433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:45 devstack sudo[113415]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-156cc8b0-b15d-4d65-a463-357478347711" returned: 0 in 0.894s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:45 devstack sudo[113432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:45 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-156cc8b0-b15d-4d65-a463-357478347711" released by "delete_volume" :: held 1.969s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created reservations ['a9ba0b7c-fb0f-4e17-af54-feaeb3f701cc', 'afed5489-03d2-4f20-a312-4a9a2ad57e7d', 'ab8526df-61fc-4526-8210-3b5b68d9ca8a', '09c4d951-bde4-41b2-8dd7-27fef1324d87'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:45 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 0.837s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358e115-1ae5-4a9d-83a3-6d6ae199bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b276b3-5ece-4cfb-afe0-56a85ee33b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:45 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Volume volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e (b9397aa9-26aa-43ae-8719-b1c93ce1fb6e): created successfully Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b276b3-5ece-4cfb-afe0-56a85ee33b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Flow 'volume_create_manager' (f1ef4bac-0970-42b0-82ef-8674ab60268c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-5a6efff8-8222-49ca-97a6-ce7e36753492-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:45 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-7f07f04a-16ed-410b-a556-fa7f30178f2f tempest-VolumeDependencyTests-2028328281 None] Created volume successfully. Jun 23 14:18:45 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:45 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-5a6efff8-8222-49ca-97a6-ce7e36753492-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-quobyte-5a6efff8-8222-49ca-97a6-ce7e36753492" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-5a6efff8-8222-49ca-97a6-ce7e36753492" acquired by "delete_volume" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[17064bcc-63dc-4e53-8e12-dc834d5b5953]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:45 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 Jun 23 14:18:45 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:46 devstack sudo[113433]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" returned: 0 in 1.083s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:46 devstack sudo[113484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add Jun 23 14:18:46 devstack sudo[113484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:46 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 1 in 1.296s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Downloaded image a1b08447-2e79-487e-b6d3-a8f71b8690d6 ((None, [{'url': 'file:///opt/stack/data/glance/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'metadata': {}}])) to volume 0f2a48c9-132c-47f9-a969-de8b3c8545d4 successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Temporary image a1b08447-2e79-487e-b6d3-a8f71b8690d6 for user f35747dca5204f54803b82fbab80eff9 is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Marking volume 0f2a48c9-132c-47f9-a969-de8b3c8545d4 as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Copying metadata from image a1b08447-2e79-487e-b6d3-a8f71b8690d6 to 0f2a48c9-132c-47f9-a969-de8b3c8545d4. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Creating volume glance metadata for volume 0f2a48c9-132c-47f9-a969-de8b3c8545d4 backed by image a1b08447-2e79-487e-b6d3-a8f71b8690d6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a4dc2db819062dd746570dc7f0964de4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Creating offline snapshot 7468fdbc-7283-430d-963d-b2201229ade1 of volume b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f2717-49ce-463f-8fd7-5b2e06dca384]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eb7ed6-4d4b-4426-9f8d-bf3e200ad6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4', 'volume_size': 1, 'image_id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4dc2db819062dd746570dc7f0964de4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '551b41faaa8c4774b74a2966363d2e34', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '004d13134f32612b98a795ebc5e89d809450e2d59e56ffe1e9ff20f32133e0762cc4ca000a964956fd9ec2d1da6c19ba49cb91369edb8b3913c8e2e4d6949541', 'id': 'a1b08447-2e79-487e-b6d3-a8f71b8690d6', 'created_at': datetime.datetime(2026, 6, 23, 12, 18, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 18, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a1b08447-2e79-487e-b6d3-a8f71b8690d6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b3754-d466-44df-88a1-c255a16bb3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:46 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Volume volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 (0f2a48c9-132c-47f9-a969-de8b3c8545d4): created successfully Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5b3754-d466-44df-88a1-c255a16bb3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Flow 'volume_create_manager' (1cda1e0e-2a92-41cd-a163-3418a2651dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-942c6f71-3d22-47ef-b763-79328cb14c96 tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Created volume successfully. Jun 23 14:18:46 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.072s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:46 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Deleted volume successfully. Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0ee19fca-5f23-4d4c-ae4a-e8798adf8de2 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-156cc8b0-b15d-4d65-a463-357478347711-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:46 devstack sudo[113487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:18:46 devstack sudo[113487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:46 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492" returned: 0 in 1.249s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:46 devstack sudo[113495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492 Jun 23 14:18:46 devstack sudo[113495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:47 devstack sudo[113484]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add" returned: 0 in 1.010s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:47 devstack sudo[113497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add Jun 23 14:18:47 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:47 devstack sudo[113487]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 0.961s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:47 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 1G Jun 23 14:18:47 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Acquiring lock "cinder-0f2a48c9-132c-47f9-a969-de8b3c8545d4-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "cinder-0f2a48c9-132c-47f9-a969-de8b3c8545d4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Acquiring lock "cinder-quobyte-0f2a48c9-132c-47f9-a969-de8b3c8545d4" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "cinder-quobyte-0f2a48c9-132c-47f9-a969-de8b3c8545d4" acquired by "delete_volume" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[016c0113-7601-43ba-8300-7ba3bce4bd33]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:47 devstack sudo[113495]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-5a6efff8-8222-49ca-97a6-ce7e36753492" returned: 0 in 0.808s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-5a6efff8-8222-49ca-97a6-ce7e36753492" released by "delete_volume" :: held 2.143s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:47 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:47 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created reservations ['d21fb6b0-7e6d-4437-b7fe-6fe4ed27729d', '51bcb4ed-6c33-4533-bbcb-c3b2855be2a3', '15729f49-9e64-4960-8c17-b8afaaaee3f8', '3756f77b-fc62-41ca-800c-365134e4cb00'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:47 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754.3f8d8c82-e6bf-4966-b10a-52e36d8f1add" returned: 0 in 0.824s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:47 devstack sudo[113508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:47 devstack sudo[113508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-3f8d8c82-e6bf-4966-b10a-52e36d8f1add" released by "_delete_snapshot" :: held 3.988s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" released by "delete_snapshot" :: held 4.031s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Created reservations ['b2bab883-d271-4fad-8839-1a4eb9100b54', '5e15dea8-64e9-4f5d-8ea4-d86dbce9de24', '54d1a7bb-be7e-4660-bcb1-d4be01e7da04', 'ef507ed4-2a2b-4a54-9f8e-c35beabb3ab1'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Delete snapshot completed successfully. Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-df5d7ffc-71fa-4190-a669-60a92b4c012c tempest-CinderUnicodeTest-906946386 None] Lock "cinder-3f8d8c82-e6bf-4966-b10a-52e36d8f1add-delete_snapshot" released by "delete_snapshot" :: held 4.234s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Lock "cinder-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-quobyte-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe31dcb-4549-4723-89c6-24a4ba2cf64d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:48 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 1G" returned: 0 in 1.194s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:48 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 Jun 23 14:18:48 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:48 devstack sudo[113516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 Jun 23 14:18:48 devstack sudo[113516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:48 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 0 in 1.171s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:48 devstack sudo[113508]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.954s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:48 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Deleted volume successfully. Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-ef671d8d-b244-4a09-a673-e9f3771ced2e-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-e37f6680-19e0-454b-b5a5-066f03ab8284 tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-5a6efff8-8222-49ca-97a6-ce7e36753492-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:48 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:48 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:48 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-ef671d8d-b244-4a09-a673-e9f3771ced2e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "cinder-quobyte-ef671d8d-b244-4a09-a673-e9f3771ced2e" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-ef671d8d-b244-4a09-a673-e9f3771ced2e" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ce3b5-ab59-45ea-9577-d95bab7a2eb0]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:49 devstack sudo[113525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e Jun 23 14:18:49 devstack sudo[113525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:49 devstack sudo[113516]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" returned: 0 in 1.037s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:49 devstack sudo[113534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754 Jun 23 14:18:49 devstack sudo[113534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:49 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1" returned: 0 in 1.008s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:49 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 is being set with open permissions: ugo+rw Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:49 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 Jun 23 14:18:49 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:49 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 1 in 1.028s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:49 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4 Jun 23 14:18:49 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:49 devstack sudo[113525]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e" returned: 0 in 0.935s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:50 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e Jun 23 14:18:50 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:50 devstack sudo[113534]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" returned: 0 in 0.796s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754" released by "delete_volume" :: held 1.920s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:50 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Created reservations ['1c2ff7cd-9a0f-45ee-b5b9-8d615b11209e', 'dfcb7257-5164-4b01-b333-7ac977bc1539', '4c8718e6-0bbf-455f-b925-c2da46a5ce03', 'f93c45b8-57b3-41aa-8b89-810d6cf0aa72'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1" returned: 0 in 0.812s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:50 devstack sudo[113552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info Jun 23 14:18:50 devstack sudo[113552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:50 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:50 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:50 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-0f2a48c9-132c-47f9-a969-de8b3c8545d4" returned: 0 in 0.783s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-99a120fa-6ab5-4acb-8efe-d211a69f194c-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "cinder-quobyte-0f2a48c9-132c-47f9-a969-de8b3c8545d4" released by "delete_volume" :: held 3.090s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Lock "cinder-99a120fa-6ab5-4acb-8efe-d211a69f194c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Acquiring lock "cinder-quobyte-99a120fa-6ab5-4acb-8efe-d211a69f194c" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Created reservations ['1aaac726-19d6-43aa-bae3-b43c8dde177e', 'b61a9d5b-dd50-409e-bd48-af7dda0761a9', '3c6379e6-340d-4342-bd04-782b9484b608', '1dc7a78d-f7ca-4559-8c56-ac9b5b437301'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-99a120fa-6ab5-4acb-8efe-d211a69f194c" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:50 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8a1189-01e5-4aba-8546-0a72e40b3caa]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-ef671d8d-b244-4a09-a673-e9f3771ced2e" returned: 0 in 0.829s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-quobyte-ef671d8d-b244-4a09-a673-e9f3771ced2e" released by "delete_volume" :: held 1.833s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:50 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c Jun 23 14:18:50 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:50 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Created reservations ['ce8b05b2-3411-4fb9-9494-747164c59e02', 'bc5ca397-c235-4767-89ed-ad73132556aa', '043e6c1a-6c33-4e43-a782-1f0d2eda191c', '2c0b9478-14c8-4cf4-9340-cc730f650607'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:51 devstack sudo[113560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:51 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:51 devstack sudo[113562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:51 devstack sudo[113562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:51 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:51 devstack sudo[113552]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info" returned: 0 in 1.126s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:51 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info is being set with open permissions: ugo+rw Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.069s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:51 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Deleted volume successfully. Jun 23 14:18:51 devstack sudo[113566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info Jun 23 14:18:51 devstack sudo[113566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-9c05ae2b-27e2-46d8-8a1f-e7828f4c08b8 tempest-CinderUnicodeTest-906946386 None] Lock "cinder-7834e2f5-43b7-4d4f-b8eb-1009f0a3e754-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:51 devstack sudo[113568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:51 devstack sudo[113568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:52 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c" returned: 0 in 1.299s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:52 devstack sudo[113574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c Jun 23 14:18:52 devstack sudo[113574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:52 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.299s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Deleted volume successfully. Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-ce9149c4-c25c-4eb7-9fa5-dfb85dc03bce tempest-VolumeAndVolumeTypeFromImageTest-568829321 None] Lock "cinder-0f2a48c9-132c-47f9-a969-de8b3c8545d4-delete_volume" released by "delete_volume" :: held 4.906s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:52 devstack sudo[113562]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.349s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Deleted volume successfully. Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-cc397af3-328c-4048-b9b4-78a025de0ebc tempest-CreateVolumesFromSourceVolumeTest-981204537 None] Lock "cinder-ef671d8d-b244-4a09-a673-e9f3771ced2e-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:52 devstack sudo[113566]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.info" returned: 0 in 1.209s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.460s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-33ed098e-02a6-4d2d-8404-430e4650dea8 tempest-VolumeDependencyTests-2028328281 None] Create snapshot completed successfully Jun 23 14:18:52 devstack sudo[113568]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.284s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:18:53 devstack sudo[113574]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-99a120fa-6ab5-4acb-8efe-d211a69f194c" returned: 0 in 0.938s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Lock "cinder-quobyte-99a120fa-6ab5-4acb-8efe-d211a69f194c" released by "delete_volume" :: held 2.304s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Created reservations ['2298410c-508d-4315-8963-e50e1c2500c2', '0b5b3bb5-5d7e-471c-afc9-744ce90d62b7', 'bf7d0da6-210c-4df3-aee8-2baf980d626b', '741e2ca4-000f-48f1-b5a3-cb6500178808'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:53 devstack sudo[113580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:18:53 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:54 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.936s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:18:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Deleted volume successfully. Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-bb6fa224-9b7b-4d49-8e05-a1bd56cf010b tempest-CinderUnicodeTest-906946386 None] Lock "cinder-99a120fa-6ab5-4acb-8efe-d211a69f194c-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Flow 'volume_create_manager' (bb6e714f-b01a-400e-88a8-123969597f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba92aa7-681f-4268-83f3-74e7059e598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba92aa7-681f-4268-83f3-74e7059e598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-15234559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10c97dc-1fa7-485a-9be2-aa29e113dc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0076b5def6c241f98c040e29ffc99080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7468fdbc-7283-430d-963d-b2201229ade1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:54Z,use_quota=True,user_id='4ad33428000b47adbc2c12507a563cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c4ba1b-d0ef-44df-a01b-5a81476c3136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c4ba1b-d0ef-44df-a01b-5a81476c3136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b672ce51-0229-46af-b204-5d804d0adaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b672ce51-0229-46af-b204-5d804d0adaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd10c97dc-1fa7-485a-9be2-aa29e113dc6a', 'volume_name': 'volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a', 'volume_size': 1, 'snapshot_id': '7468fdbc-7283-430d-963d-b2201229ade1'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b69906c-4771-464c-8466-dc8a6283b8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b69906c-4771-464c-8466-dc8a6283b8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18984871-96ef-469b-831b-15bdbd0c9be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:54 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Volume d10c97dc-1fa7-485a-9be2-aa29e113dc6a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a', 'volume_size': 1, 'snapshot_id': '7468fdbc-7283-430d-963d-b2201229ade1'} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-quobyte-7468fdbc-7283-430d-963d-b2201229ade1-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-7468fdbc-7283-430d-963d-b2201229ade1-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Creating volume d10c97dc-1fa7-485a-9be2-aa29e113dc6a from snapshot 7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-quobyte-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] snapshot: 7468fdbc-7283-430d-963d-b2201229ade1, volume: d10c97dc-1fa7-485a-9be2-aa29e113dc6a, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[98036dbb-a258-44d0-82f0-0b5610a618d8]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:54 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 Jun 23 14:18:54 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:55 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1" returned: 0 in 1.133s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:18:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:18:55 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:18:55 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a656ca-2bfd-4101-bf62-86855b2a30f9]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:18:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:55 devstack sudo[113589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:18:55 devstack sudo[113589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:56 devstack sudo[113589]: pam_unix(sudo:session): session closed for user root Jun 23 14:18:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 0.934s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:18:56 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:18:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:18:56 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a Jun 23 14:18:56 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=108,cinder:UPDATE=171,cinder:INSERT=41,cinder:DELETE=15 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (3a62f7d4-799e-4e37-aad5-921fb2a4e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe86f09-6df6-4d9c-a691-f99a9c6fc65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe86f09-6df6-4d9c-a691-f99a9c6fc65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395346658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7596125c-968f-4735-a4ae-a4106fb39ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:59Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f36c4eb-4286-4d71-a6c5-98dcd0474c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f36c4eb-4286-4d71-a6c5-98dcd0474c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fafc8a6-8b0d-4647-861b-fce1312e22a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fafc8a6-8b0d-4647-861b-fce1312e22a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7596125c-968f-4735-a4ae-a4106fb39ee4', 'volume_name': 'volume-7596125c-968f-4735-a4ae-a4106fb39ee4', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ff3efe-ef09-4445-8223-cb551b1dead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ff3efe-ef09-4445-8223-cb551b1dead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28089b25-c9b6-4b00-831c-2f615e776066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:18:59 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume 7596125c-968f-4735-a4ae-a4106fb39ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7596125c-968f-4735-a4ae-a4106fb39ee4', 'volume_size': 1} Jun 23 14:18:59 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:02 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" returned: 0 in 6.018s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:02 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf486c-766c-4882-a6e0-50c7dd696dcd]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:02 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:02 devstack sudo[113606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:19:02 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:02 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Flow 'volume_create_manager' (d8c6acc2-87c4-4a1a-93c0-7a8fddd20821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d455da73-a0e4-4dec-abd2-04f726cf75a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d455da73-a0e4-4dec-abd2-04f726cf75a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea21393-1b8d-4a72-acf2-830a7aca1ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dd29197ee2415a9b3db5ca0f06a14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:03Z,use_quota=True,user_id='7b9dc3fc9e4840e7b9b3f61627fff650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda9e740-65fc-4896-af47-4319ecb7db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda9e740-65fc-4896-af47-4319ecb7db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48e45e7-ebeb-449e-9a4d-18d7ceb501d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.image.glance [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Creating Keystone auth plugin from conf {{(pid=93605) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48e45e7-ebeb-449e-9a4d-18d7ceb501d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ea21393-1b8d-4a72-acf2-830a7aca1ba1', 'volume_name': 'volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1', 'volume_size': 1, 'image_id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcf85b-318e-4657-92a8-6987e4d5336a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb337ce04c66e29643bbff6430cca7d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47dd29197ee2415a9b3db5ca0f06a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ac90bf538075856d8dd38681e5d34c779477e744613e39f0a92104791518b7e32c880004cf91bc31101a3ff317a1589b656d0acd36fbb873945b6650996efcc', 'id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'created_at': datetime.datetime(2026, 6, 23, 12, 18, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 19, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7fcf85b-318e-4657-92a8-6987e4d5336a/file', 'properties': {}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a3c3e6-f5c7-4ff8-9742-760f9f7c9286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a3c3e6-f5c7-4ff8-9742-760f9f7c9286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64047189-0be0-48f4-ab74-61434c23b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:03 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Volume 6ea21393-1b8d-4a72-acf2-830a7aca1ba1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1', 'volume_size': 1, 'image_id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcf85b-318e-4657-92a8-6987e4d5336a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb337ce04c66e29643bbff6430cca7d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47dd29197ee2415a9b3db5ca0f06a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ac90bf538075856d8dd38681e5d34c779477e744613e39f0a92104791518b7e32c880004cf91bc31101a3ff317a1589b656d0acd36fbb873945b6650996efcc', 'id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'created_at': datetime.datetime(2026, 6, 23, 12, 18, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 19, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7fcf85b-318e-4657-92a8-6987e4d5336a/file', 'properties': {}}, 'image_service': } Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Trying to clone 6ea21393-1b8d-4a72-acf2-830a7aca1ba1 from image b7fcf85b-318e-4657-92a8-6987e4d5336a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcf85b-318e-4657-92a8-6987e4d5336a', 'metadata': {}}]). {{(pid=93605) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 14:19:03 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Image download 0.00 MB at 0.00 MB/s Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc37389-143f-43d3-97a5-a58f5823a731]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:03 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 1.089s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:19:03 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Converted 1024.00 MB image at 170.13 MB/s Jun 23 14:19:03 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a is being set with open permissions: ugo+rw Jun 23 14:19:03 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:03 devstack sudo[113613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a Jun 23 14:19:03 devstack sudo[113613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:03 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD Jun 23 14:19:03 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:04 devstack sudo[113613]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" returned: 0 in 0.775s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:04 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" released by "_copy_volume_from_snapshot" :: held 10.098s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-7468fdbc-7283-430d-963d-b2201229ade1-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" released by "_create_volume_from_snapshot" :: held 10.141s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.159s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.908s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395346658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7596125c-968f-4735-a4ae-a4106fb39ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:18:59Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating volume 7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:04 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:04 devstack sudo[113620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 1073741824 Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18984871-96ef-469b-831b-15bdbd0c9be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a', 'volume_size': 1, 'snapshot_id': '7468fdbc-7283-430d-963d-b2201229ade1'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:04 devstack sudo[113620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212515eb-ac04-4b87-b7fc-492fc503db30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:04 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Volume volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a (d10c97dc-1fa7-485a-9be2-aa29e113dc6a): created successfully Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (212515eb-ac04-4b87-b7fc-492fc503db30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:04 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Flow 'volume_create_manager' (bb6e714f-b01a-400e-88a8-123969597f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:04 devstack sudo[113619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD Jun 23 14:19:04 devstack sudo[113619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:04 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-8d72fc0c-8b00-47b2-9b6c-7c973631921f tempest-VolumeDependencyTests-2028328281 None] Created volume successfully. Jun 23 14:19:05 devstack sudo[113619]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD" returned: 1 in 0.865s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Temporary image b7fcf85b-318e-4657-92a8-6987e4d5336a is fetched for user 7b9dc3fc9e4840e7b9b3f61627fff650. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaa8fff-3e2a-4b66-9727-cd19a82640eb]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:05 devstack sudo[113635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD Jun 23 14:19:05 devstack sudo[113635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-7468fdbc-7283-430d-963d-b2201229ade1-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-7468fdbc-7283-430d-963d-b2201229ade1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-quobyte-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-quobyte-7468fdbc-7283-430d-963d-b2201229ade1" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:05 devstack sudo[113620]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-7468fdbc-7283-430d-963d-b2201229ade1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Deleting offline snapshot 7468fdbc-7283-430d-963d-b2201229ade1 of volume b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] snapshot_file for this snap is: volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 1073741824" returned: 0 in 1.137s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884c023-38d4-4349-aa50-65f94e22b51e]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:05 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:05 devstack sudo[113638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 Jun 23 14:19:05 devstack sudo[113638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:05 devstack sudo[113637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 Jun 23 14:19:05 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:06 devstack sudo[113635]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:06 devstack sudo[113643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD Jun 23 14:19:06 devstack sudo[113643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:06 devstack sudo[113638]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4" returned: 0 in 0.941s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:06 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28089b25-c9b6-4b00-831c-2f615e776066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7596125c-968f-4735-a4ae-a4106fb39ee4', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540d9cd1-ac38-46a5-9eff-c7044275283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1" returned: 0 in 1.052s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:19:06 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume volume-7596125c-968f-4735-a4ae-a4106fb39ee4 (7596125c-968f-4735-a4ae-a4106fb39ee4): created successfully Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540d9cd1-ac38-46a5-9eff-c7044275283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (3a62f7d4-799e-4e37-aad5-921fb2a4e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe318b42-6826-4312-80df-c6cd1be4302c]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:06 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:06 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-9c685913-9dda-4e57-93b1-fc88d2e07af3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created volume successfully. Jun 23 14:19:06 devstack sudo[113649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:19:06 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating offline snapshot 6856af0b-d268-4f9e-8841-4dd21302c843 of volume 7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae1658b-8662-4d18-82c4-601a0edbb791]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:07 devstack sudo[113643]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD" returned: 1 in 1.073s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:07 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 Jun 23 14:19:07 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:07 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 1.079s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:07 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:07 devstack sudo[113660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 Jun 23 14:19:07 devstack sudo[113660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:08 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4" returned: 0 in 0.996s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:08 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 1G Jun 23 14:19:08 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:08 devstack sudo[113660]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1" returned: 0 in 1.055s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:08 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:08 devstack sudo[113672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1 Jun 23 14:19:08 devstack sudo[113672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:09 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 1G" returned: 0 in 1.125s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7596125c-968f-4735-a4ae-a4106fb39ee4 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:09 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7596125c-968f-4735-a4ae-a4106fb39ee4 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 Jun 23 14:19:09 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:09 devstack sudo[113672]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e.7468fdbc-7283-430d-963d-b2201229ade1" returned: 0 in 0.844s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=170,cinder:SELECT=141,cinder:DELETE=18,cinder:INSERT=47 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-7468fdbc-7283-430d-963d-b2201229ade1" released by "_delete_snapshot" :: held 4.176s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" released by "delete_snapshot" :: held 4.204s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:09 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Created reservations ['e661ef55-7f2d-455a-ae88-10a6cd81c819', '44a39fb8-16a9-45b1-b688-bbd3a8d30bad', '28c1a7f5-4fa6-4a56-92aa-2c91dc44f54c', '6485b218-d4ae-4ae8-916b-b5d8208f2042'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:10 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Delete snapshot completed successfully. Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-841fa733-ad2f-454a-84ad-bddbaa447c3c tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-7468fdbc-7283-430d-963d-b2201229ade1-delete_snapshot" released by "delete_snapshot" :: held 4.382s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:10 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7596125c-968f-4735-a4ae-a4106fb39ee4 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843" returned: 0 in 0.763s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:10 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 is being set with open permissions: ugo+rw Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:10 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 Jun 23 14:19:10 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:10 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843" returned: 0 in 0.674s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:10 devstack sudo[113687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info Jun 23 14:19:10 devstack sudo[113687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:10 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-quobyte-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:11 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:11 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c14560-6f60-4b14-8417-4c8df372c298]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:11 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:19:11 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:11 devstack sudo[113687]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info" returned: 0 in 0.920s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:11 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info is being set with open permissions: ugo+rw Jun 23 14:19:11 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:11 devstack sudo[113692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info Jun 23 14:19:11 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:12 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 0.934s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:12 devstack sudo[113697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e Jun 23 14:19:12 devstack sudo[113697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:12 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.info" returned: 0 in 0.700s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.296s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.174s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea21393-1b8d-4a72-acf2-830a7aca1ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dd29197ee2415a9b3db5ca0f06a14f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:03Z,use_quota=True,user_id='7b9dc3fc9e4840e7b9b3f61627fff650',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Creating volume 6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:12 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:12 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 1073741824 Jun 23 14:19:12 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-e489b421-e3c1-470f-b2e6-bcc87676351d tempest-CreateVolumesFromSnapshotTest-1865929171 None] Create snapshot completed successfully Jun 23 14:19:12 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:12 devstack sudo[113697]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" returned: 0 in 0.768s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e" released by "delete_volume" :: held 1.817s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:12 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Created reservations ['94904c45-77c7-4237-a989-cd387e038503', '86c5c4e9-6d50-41e8-a824-409dc01e5007', '4b64912c-8422-41b3-b981-1b2874fba31b', '34002b8d-be75-4f8a-89c0-a06a4829d77c'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:13 devstack sudo[113703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:13 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-d10c97dc-1fa7-485a-9be2-aa29e113dc6a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-d10c97dc-1fa7-485a-9be2-aa29e113dc6a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "cinder-quobyte-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f0ddc-0c1d-4e6d-9e60-5ac2895967e1]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:13 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a Jun 23 14:19:13 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:13 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 1073741824" returned: 0 in 1.303s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:13 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:13 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:13 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:13 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.974s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:14 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Deleted volume successfully. Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-5499af65-3048-4966-9a7c-1f1445d9d15f tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-b9397aa9-26aa-43ae-8719-b1c93ce1fb6e-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (539bbf9c-8b18-47be-a4ba-ad34373a47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e433c6e-b416-4a61-811d-cd452227e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e433c6e-b416-4a61-811d-cd452227e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063741989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b67fd7-d368-4788-809a-d4c51a9b3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:14Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:14 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8721ee4-eae2-45dd-8b4e-03f6cfb22268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8721ee4-eae2-45dd-8b4e-03f6cfb22268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7d3188-3947-4603-a2d4-670bade48f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb7d3188-3947-4603-a2d4-670bade48f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b67fd7-d368-4788-809a-d4c51a9b3b1a', 'volume_name': 'volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444502b-fd83-4ae3-b8ac-e843774165ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e444502b-fd83-4ae3-b8ac-e843774165ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c183df-bfe8-4a2d-a518-e268b415db14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:14 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume c3b67fd7-d368-4788-809a-d4c51a9b3b1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a', 'volume_size': 1} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" returned: 0 in 1.180s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:14 devstack sudo[113718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a Jun 23 14:19:14 devstack sudo[113718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (c281e938-8b3f-4f57-b196-4df5353fe5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f951431f-9afe-4fe8-a5e8-8c588d25c0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:14 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f951431f-9afe-4fe8-a5e8-8c588d25c0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521910569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da378715-75c0-44d2-9d2a-711d27a00a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:15Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:14 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d88cc3d-0de6-4625-8d69-10c3156ee321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d88cc3d-0de6-4625-8d69-10c3156ee321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d7a7e6-4035-4653-aef3-43e9c8718fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d7a7e6-4035-4653-aef3-43e9c8718fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da378715-75c0-44d2-9d2a-711d27a00a6b', 'volume_name': 'volume-da378715-75c0-44d2-9d2a-711d27a00a6b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fca152e-dd06-4228-b27e-2fe8be68b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fca152e-dd06-4228-b27e-2fe8be68b522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29622596-f932-4524-8ba3-8091db2289fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume da378715-75c0-44d2-9d2a-711d27a00a6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da378715-75c0-44d2-9d2a-711d27a00a6b', 'volume_size': 1} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 0 in 1.115s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.483s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063741989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b67fd7-d368-4788-809a-d4c51a9b3b1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:14Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating volume c3b67fd7-d368-4788-809a-d4c51a9b3b1a {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:15 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:15 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a 1073741824 Jun 23 14:19:15 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Attempting download of b7fcf85b-318e-4657-92a8-6987e4d5336a ((None, [{'url': 'file:///opt/stack/data/glance/images/b7fcf85b-318e-4657-92a8-6987e4d5336a', 'metadata': {}}])) to volume 6ea21393-1b8d-4a72-acf2-830a7aca1ba1. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 14:19:15 devstack sudo[113718]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" returned: 0 in 1.008s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-quobyte-d10c97dc-1fa7-485a-9be2-aa29e113dc6a" released by "delete_volume" :: held 2.236s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Created reservations ['3ee0a09a-4f4c-4dcd-8ec6-35bc4eeeae7e', 'b286c513-8697-42ad-8f7f-982e2ae48ec2', '61395790-4ec3-43cf-aab8-e16f75b15fcc', '182a7791-c76f-4ee0-bd23-b69f03c32b9a'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc4bb2a-f1fc-480e-88ce-0b465b401015]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (3aff83f8-8811-4a89-b7f8-06344e984f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ae43ae-34be-4b63-b8da-8a3ccd932e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ae43ae-34be-4b63-b8da-8a3ccd932e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1490258273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf43e1cd-7c27-4818-80fa-11f1a196c614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:16Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08453dcc-6c98-45a9-8a30-162112a5fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08453dcc-6c98-45a9-8a30-162112a5fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a263cc3e-807c-4f58-860e-1addc9edb562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a263cc3e-807c-4f58-860e-1addc9edb562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf43e1cd-7c27-4818-80fa-11f1a196c614', 'volume_name': 'volume-bf43e1cd-7c27-4818-80fa-11f1a196c614', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9067a0ac-b1c2-45da-be1c-e573e66e8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9067a0ac-b1c2-45da-be1c-e573e66e8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb1b1bf-9385-42e3-aad0-7e7d04333436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:15 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume bf43e1cd-7c27-4818-80fa-11f1a196c614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf43e1cd-7c27-4818-80fa-11f1a196c614', 'volume_size': 1} Jun 23 14:19:15 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:16 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf Jun 23 14:19:16 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:16 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:16 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:16 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a 1073741824" returned: 0 in 1.365s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (9999550b-dbd5-48c0-b099-0448e049acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b336c6-f38f-46bc-b923-ad46d2fa340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b336c6-f38f-46bc-b923-ad46d2fa340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650474001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e48988-ff78-41ba-9b1c-97d821d6b09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:16Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f722b908-6d7e-428f-a0e7-d5496d88b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f722b908-6d7e-428f-a0e7-d5496d88b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7add1b-68ce-46dc-a217-0757787bb469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7add1b-68ce-46dc-a217-0757787bb469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e48988-ff78-41ba-9b1c-97d821d6b09b', 'volume_name': 'volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99a06b7-1c68-428b-a6bf-297eebbefe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99a06b7-1c68-428b-a6bf-297eebbefe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3e95d6-b839-47d1-b6e8-96f2a0581b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:16 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume f6e48988-ff78-41ba-9b1c-97d821d6b09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b', 'volume_size': 1} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:16 devstack sudo[113733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a Jun 23 14:19:16 devstack sudo[113733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:16 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf" returned: 0 in 1.162s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:16 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (8f670fd4-2b32-4aba-bd8d-9ea1b4fea4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b887e-bade-414c-b707-c3b0941997b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4b887e-bade-414c-b707-c3b0941997b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435207429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1820d93-9513-4d42-a8c4-eeef790aa43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:17Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c315c08-b49b-48e1-a461-cec60c634f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:17 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c315c08-b49b-48e1-a461-cec60c634f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:17 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdee1da5-7159-4877-88be-146345673254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdee1da5-7159-4877-88be-146345673254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1820d93-9513-4d42-a8c4-eeef790aa43d', 'volume_name': 'volume-a1820d93-9513-4d42-a8c4-eeef790aa43d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821b0f9f-6eaf-4324-a317-dce8836679dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (821b0f9f-6eaf-4324-a317-dce8836679dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363d9f08-f148-46e3-ba76-133c6735236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume a1820d93-9513-4d42-a8c4-eeef790aa43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1820d93-9513-4d42-a8c4-eeef790aa43d', 'volume_size': 1} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:17 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 1.063s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:17 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Deleted volume successfully. Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0978dd49-20e3-4383-8a44-684c25e2b070 tempest-VolumeDependencyTests-2028328281 None] Lock "cinder-d10c97dc-1fa7-485a-9be2-aa29e113dc6a-delete_volume" released by "delete_volume" :: held 3.977s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:17 devstack sudo[113733]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a" returned: 0 in 1.251s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] <== create_volume: return (2848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.851s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.870s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521910569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da378715-75c0-44d2-9d2a-711d27a00a6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:15Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating volume da378715-75c0-44d2-9d2a-711d27a00a6b {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:17 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c183df-bfe8-4a2d-a518-e268b415db14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:17 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b 1073741824 Jun 23 14:19:17 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:17 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f67d1e6-b338-4bfa-986b-0f391386bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:17 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a (c3b67fd7-d368-4788-809a-d4c51a9b3b1a): created successfully Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f67d1e6-b338-4bfa-986b-0f391386bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (539bbf9c-8b18-47be-a4ba-ad34373a47d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:18 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf" returned: 1 in 1.041s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7fcf85b-318e-4657-92a8-6987e4d5336a_10yzy7kf' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[41292683-d4b5-4dbb-a3a4-ba1806c85668]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:18 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-62b5287b-03ba-45ec-a6cf-97378b28dc05 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created volume successfully. Jun 23 14:19:18 devstack sudo[113747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD Jun 23 14:19:18 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:18 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b 1073741824" returned: 0 in 0.959s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:18 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD" returned: 0 in 0.940s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:18 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:18 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b Jun 23 14:19:18 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:19 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD Jun 23 14:19:19 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:19 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b" returned: 0 in 1.035s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.995s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1490258273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf43e1cd-7c27-4818-80fa-11f1a196c614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:16Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating volume bf43e1cd-7c27-4818-80fa-11f1a196c614 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:19 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:20 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:20 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD" returned: 1 in 1.053s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] b7fcf85b-318e-4657-92a8-6987e4d5336a was raw, converting to raw {{(pid=93605) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:20 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 1073741824 Jun 23 14:19:20 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29622596-f932-4524-8ba3-8091db2289fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da378715-75c0-44d2-9d2a-711d27a00a6b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b01f10b-1ffc-4ff1-9d5e-c65cfea01541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:20 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:20 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:20 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume volume-da378715-75c0-44d2-9d2a-711d27a00a6b (da378715-75c0-44d2-9d2a-711d27a00a6b): created successfully Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b01f10b-1ffc-4ff1-9d5e-c65cfea01541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:20 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (c281e938-8b3f-4f57-b196-4df5353fe5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:20 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-5fde9b71-5231-45df-86d0-a9dbaeafb7bc tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created volume successfully. Jun 23 14:19:21 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 0 in 1.065s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7fcf85b-318e-4657-92a8-6987e4d5336a_042zujxodevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:19:21 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:21 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 1G Jun 23 14:19:21 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:21 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 1073741824" returned: 0 in 1.221s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:21 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 Jun 23 14:19:21 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:21 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 1G" returned: 0 in 0.737s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1bdad-3fc2-4429-a730-c384f5fdfa2c]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:21 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:22 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:22 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614" returned: 0 in 0.759s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:22 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1650474001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e48988-ff78-41ba-9b1c-97d821d6b09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:16Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating volume f6e48988-ff78-41ba-9b1c-97d821d6b09b {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:22 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb1b1bf-9385-42e3-aad0-7e7d04333436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf43e1cd-7c27-4818-80fa-11f1a196c614', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:22 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b 1073741824 Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37863c2-03cb-48cd-818d-6d36b9966a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:22 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:22 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 (bf43e1cd-7c27-4818-80fa-11f1a196c614): created successfully Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37863c2-03cb-48cd-818d-6d36b9966a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (3aff83f8-8811-4a89-b7f8-06344e984f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:22 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-76617060-4fc3-438f-9a7d-d30eace9004e tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created volume successfully. Jun 23 14:19:22 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 0 in 0.997s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:22 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:23 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:23 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:23 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b 1073741824" returned: 0 in 1.088s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:23 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b Jun 23 14:19:23 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:23 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 1 in 0.912s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Downloaded image b7fcf85b-318e-4657-92a8-6987e4d5336a ((None, [{'url': 'file:///opt/stack/data/glance/images/b7fcf85b-318e-4657-92a8-6987e4d5336a', 'metadata': {}}])) to volume 6ea21393-1b8d-4a72-acf2-830a7aca1ba1 successfully. {{(pid=93605) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Temporary image b7fcf85b-318e-4657-92a8-6987e4d5336a for user 7b9dc3fc9e4840e7b9b3f61627fff650 is deleted. {{(pid=93605) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.volume_utils [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Marking volume 6ea21393-1b8d-4a72-acf2-830a7aca1ba1 as bootable. {{(pid=93605) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Copying metadata from image b7fcf85b-318e-4657-92a8-6987e4d5336a to 6ea21393-1b8d-4a72-acf2-830a7aca1ba1. {{(pid=93605) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Creating volume glance metadata for volume 6ea21393-1b8d-4a72-acf2-830a7aca1ba1 backed by image b7fcf85b-318e-4657-92a8-6987e4d5336a with: {'image_id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fb337ce04c66e29643bbff6430cca7d8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93605) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64047189-0be0-48f4-ab74-61434c23b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1', 'volume_size': 1, 'image_id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7fcf85b-318e-4657-92a8-6987e4d5336a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fb337ce04c66e29643bbff6430cca7d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47dd29197ee2415a9b3db5ca0f06a14f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ac90bf538075856d8dd38681e5d34c779477e744613e39f0a92104791518b7e32c880004cf91bc31101a3ff317a1589b656d0acd36fbb873945b6650996efcc', 'id': 'b7fcf85b-318e-4657-92a8-6987e4d5336a', 'created_at': datetime.datetime(2026, 6, 23, 12, 18, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 12, 19, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7fcf85b-318e-4657-92a8-6987e4d5336a/file', 'properties': {}}, 'image_service': }' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b12b61-3cc6-4b3a-ab0f-52ece5fec1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:23 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Volume volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 (6ea21393-1b8d-4a72-acf2-830a7aca1ba1): created successfully Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b12b61-3cc6-4b3a-ab0f-52ece5fec1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Flow 'volume_create_manager' (d8c6acc2-87c4-4a1a-93c0-7a8fddd20821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:23 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b" returned: 0 in 0.774s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.740s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-435207429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1820d93-9513-4d42-a8c4-eeef790aa43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf6269e37f740679a5cb9be9b679c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:17Z,use_quota=True,user_id='2c3084e97fa344b5ab062cac57cfa5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Creating volume a1820d93-9513-4d42-a8c4-eeef790aa43d {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:23 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:23 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:23 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-a87d77dd-c396-4477-a285-6c6ede0b3a3b tempest-VolumeImageDependencyTests-956442565 None] Created volume successfully. Jun 23 14:19:24 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d 1073741824 Jun 23 14:19:24 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3e95d6-b839-47d1-b6e8-96f2a0581b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e97f075-b14a-404f-9cf8-8b9843d74f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:24 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b (f6e48988-ff78-41ba-9b1c-97d821d6b09b): created successfully Jun 23 14:19:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e97f075-b14a-404f-9cf8-8b9843d74f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:24 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (9999550b-dbd5-48c0-b099-0448e049acd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:24 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-15c689c0-52c4-4d78-ac67-865a1b6e2266 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created volume successfully. Jun 23 14:19:24 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:24 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d 1073741824" returned: 0 in 1.017s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:25 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d Jun 23 14:19:25 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Acquiring lock "cinder-6ea21393-1b8d-4a72-acf2-830a7aca1ba1-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Lock "cinder-6ea21393-1b8d-4a72-acf2-830a7aca1ba1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Acquiring lock "cinder-quobyte-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Lock "cinder-quobyte-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" acquired by "delete_volume" :: waited 0.050s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e5855-3fdc-4bd0-a561-ce50d0b2441b]: (4, 'raw') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:25 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:25 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:25 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d" returned: 0 in 0.912s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363d9f08-f148-46e3-ba76-133c6735236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1820d93-9513-4d42-a8c4-eeef790aa43d', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83614263-c8ef-4844-b357-144de86e0534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:25 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Volume volume-a1820d93-9513-4d42-a8c4-eeef790aa43d (a1820d93-9513-4d42-a8c4-eeef790aa43d): created successfully Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83614263-c8ef-4844-b357-144de86e0534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:25 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Flow 'volume_create_manager' (8f670fd4-2b32-4aba-bd8d-9ea1b4fea4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:26 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-188a9ddb-f432-4fe9-b0fb-bd8da7972c3b tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created volume successfully. Jun 23 14:19:26 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 0 in 0.890s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:26 devstack sudo[113813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:26 devstack sudo[113813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Flow 'volume_create_manager' (be5cc1f6-97ec-457e-8161-62fcc80ae221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72abec62-f526-4acc-ab02-62b7bee87f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72abec62-f526-4acc-ab02-62b7bee87f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1554238116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b495d62c-36ab-4937-ae09-52300ccf3282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc01fd79b6a4242b8f66d007e625f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:26Z,use_quota=True,user_id='383f45fef1ad46778502cd3b900cf990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393007d5-6d59-4289-a48c-522183ad9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393007d5-6d59-4289-a48c-522183ad9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f42422-99bd-4a76-9b39-c3caa8bca437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f42422-99bd-4a76-9b39-c3caa8bca437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b495d62c-36ab-4937-ae09-52300ccf3282', 'volume_name': 'volume-b495d62c-36ab-4937-ae09-52300ccf3282', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22fa85f-d0c3-4160-a095-e69893e1ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22fa85f-d0c3-4160-a095-e69893e1ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aa1f4d-15e5-493f-ab1d-d711443d5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:26 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Volume b495d62c-36ab-4937-ae09-52300ccf3282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b495d62c-36ab-4937-ae09-52300ccf3282', 'volume_size': 1} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1554238116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b495d62c-36ab-4937-ae09-52300ccf3282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc01fd79b6a4242b8f66d007e625f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:26Z,use_quota=True,user_id='383f45fef1ad46778502cd3b900cf990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)}" {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Creating volume b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:26 devstack cinder-volume[93605]: INFO cinder.volume.drivers.remotefs [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] casted to osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 Jun 23 14:19:26 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 1073741824 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:26 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 1073741824 Jun 23 14:19:26 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-a1820d93-9513-4d42-a8c4-eeef790aa43d-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-a1820d93-9513-4d42-a8c4-eeef790aa43d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:27 devstack sudo[113813]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-a1820d93-9513-4d42-a8c4-eeef790aa43d" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 1 in 0.836s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1' failed. Not Retrying. {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-a1820d93-9513-4d42-a8c4-eeef790aa43d" acquired by "delete_volume" :: waited 0.030s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:27 devstack sudo[113820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1 Jun 23 14:19:27 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c5eed2-318b-43d6-af22-2f4f73d9c0df]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:27 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d Jun 23 14:19:27 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:27 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 1073741824" returned: 0 in 0.901s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:27 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:27 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:27 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" returned: 0 in 0.745s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Lock "cinder-quobyte-6ea21393-1b8d-4a72-acf2-830a7aca1ba1" released by "delete_volume" :: held 2.603s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Created reservations ['d285e28a-01a4-4c51-ab0a-9138da25d9a2', '7ad369e0-0c82-4d08-84fa-ce1fe49e51ab', '7b164356-f0e8-4920-b470-5378c5311099', 'dfb114bf-a0d3-45d4-a884-dde19b814574'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:27 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:28 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d" returned: 0 in 0.855s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:28 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:28 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:28 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d Jun 23 14:19:28 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:28 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 0.779s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'} {{(pid=93605) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aa1f4d-15e5-493f-ab1d-d711443d5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b495d62c-36ab-4937-ae09-52300ccf3282', 'volume_size': 1}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a8b729-be11-4d58-8f61-896bede934af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:28 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Volume volume-b495d62c-36ab-4937-ae09-52300ccf3282 (b495d62c-36ab-4937-ae09-52300ccf3282): created successfully Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a8b729-be11-4d58-8f61-896bede934af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Flow 'volume_create_manager' (be5cc1f6-97ec-457e-8161-62fcc80ae221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:28 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-42a268cc-861e-45c2-83a7-31d5d59cc8b0 tempest-SnapshotDependencyTests-1040258478 None] Created volume successfully. Jun 23 14:19:28 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a1820d93-9513-4d42-a8c4-eeef790aa43d" returned: 0 in 0.706s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-a1820d93-9513-4d42-a8c4-eeef790aa43d" released by "delete_volume" :: held 1.613s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:28 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.751s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:28 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Deleted volume successfully. Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-95250fb8-d57f-4d49-8684-01315e68c12e tempest-VolumeImageDependencyTests-956442565 None] Lock "cinder-6ea21393-1b8d-4a72-acf2-830a7aca1ba1-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['95ce7181-2a6d-4498-9231-4c4e1cbe130c', '3aa780f7-4c28-4ccc-9507-80c3370aa03a', 'a29a4bf4-956c-4f11-9bf8-259b54d6fc5f', '23ae2d68-8f83-4189-900e-5f2ac4bbd7f9'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:28 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:28 devstack sudo[113840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:28 devstack sudo[113840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Creating offline snapshot 57fabcb6-c940-461d-809e-e0cd88acfd04 of volume b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0dbd1-8716-47ac-b49e-70bf04748f7d]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:29 devstack sudo[113842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:29 devstack sudo[113842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-f6e48988-ff78-41ba-9b1c-97d821d6b09b-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-f6e48988-ff78-41ba-9b1c-97d821d6b09b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-f6e48988-ff78-41ba-9b1c-97d821d6b09b" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-f6e48988-ff78-41ba-9b1c-97d821d6b09b" acquired by "delete_volume" :: waited 0.031s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[a683fe91-9725-4a26-8a03-f8674c25b82f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:29 devstack sudo[113844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b Jun 23 14:19:29 devstack sudo[113844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:29 devstack sudo[113840]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.883s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:29 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleted volume successfully. Jun 23 14:19:29 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f2a3f0f9-dffd-4361-b434-21bfaba1f546 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-a1820d93-9513-4d42-a8c4-eeef790aa43d-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:30 devstack sudo[113842]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 1.111s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 1G {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:30 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 1G Jun 23 14:19:30 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:30 devstack sudo[113844]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b" returned: 0 in 1.092s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:30 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:30 devstack sudo[113856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b Jun 23 14:19:30 devstack sudo[113856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:31 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 1G" returned: 0 in 1.050s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b495d62c-36ab-4937-ae09-52300ccf3282 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:31 devstack sudo[113863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b495d62c-36ab-4937-ae09-52300ccf3282 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 Jun 23 14:19:31 devstack sudo[113863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:31 devstack sudo[113856]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-f6e48988-ff78-41ba-9b1c-97d821d6b09b" returned: 0 in 0.745s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-f6e48988-ff78-41ba-9b1c-97d821d6b09b" released by "delete_volume" :: held 1.895s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['3ef26ce0-59a3-4023-b1e7-06ed4fdbf315', 'c1670aca-0870-4b90-85fa-cfc84f19d280', 'f9991335-99a9-48da-90ca-7ee2a38ba5d6', '96376144-1aea-4568-ad98-c3aa388cc00d'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:31 devstack sudo[113865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:31 devstack sudo[113865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-bf43e1cd-7c27-4818-80fa-11f1a196c614-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-bf43e1cd-7c27-4818-80fa-11f1a196c614-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-bf43e1cd-7c27-4818-80fa-11f1a196c614" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-bf43e1cd-7c27-4818-80fa-11f1a196c614" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e7b001-1a38-41d4-81ae-35b5d8a609fc]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:31 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:31 devstack sudo[113867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 Jun 23 14:19:31 devstack sudo[113867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:32 devstack sudo[113863]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b495d62c-36ab-4937-ae09-52300ccf3282 -F qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04" returned: 0 in 0.824s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:32 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 is being set with open permissions: ugo+rw Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:32 devstack sudo[113873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 Jun 23 14:19:32 devstack sudo[113873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:32 devstack sudo[113865]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.722s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:32 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleted volume successfully. Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-223593d7-8ff9-494b-92c9-ec99dc251a41 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-f6e48988-ff78-41ba-9b1c-97d821d6b09b-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:32 devstack sudo[113867]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614" returned: 0 in 0.796s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:32 devstack sudo[113878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614 Jun 23 14:19:32 devstack sudo[113878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:32 devstack sudo[113873]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04" returned: 0 in 0.738s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:32 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:32 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info Jun 23 14:19:32 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:33 devstack sudo[113878]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-bf43e1cd-7c27-4818-80fa-11f1a196c614" returned: 0 in 0.662s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-bf43e1cd-7c27-4818-80fa-11f1a196c614" released by "delete_volume" :: held 1.508s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['dcdf3062-f697-40c5-81f4-cccd6fdd7db9', '013aeba7-3358-44e0-a0b7-f60bf51e2cd3', '5773cef7-d784-4750-87dd-51621ef2aa2c', '32b714e9-d9a0-4e43-847c-19934805dc56'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:33 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:33 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:33 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info" returned: 0 in 0.701s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:33 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info is being set with open permissions: ugo+rw Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:33 devstack sudo[113888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info Jun 23 14:19:33 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-da378715-75c0-44d2-9d2a-711d27a00a6b-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:33 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-da378715-75c0-44d2-9d2a-711d27a00a6b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-da378715-75c0-44d2-9d2a-711d27a00a6b" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-da378715-75c0-44d2-9d2a-711d27a00a6b" acquired by "delete_volume" :: waited 0.018s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b9c9e-be21-4be7-a040-539a5129d32b]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:34 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.695s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:34 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleted volume successfully. Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-f9c721f5-d0f3-42fa-a85e-2cfad5a6b1b3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-bf43e1cd-7c27-4818-80fa-11f1a196c614-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:34 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b Jun 23 14:19:34 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:34 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.info" returned: 0 in 0.707s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.229s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:34 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-4df93c5e-63e6-4c85-962a-3972b8cba2ce tempest-SnapshotDependencyTests-1040258478 None] Create snapshot completed successfully Jun 23 14:19:34 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b" returned: 0 in 0.755s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:34 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:34 devstack sudo[113898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b Jun 23 14:19:34 devstack sudo[113898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:35 devstack sudo[113898]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-da378715-75c0-44d2-9d2a-711d27a00a6b" returned: 0 in 0.650s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-da378715-75c0-44d2-9d2a-711d27a00a6b" released by "delete_volume" :: held 1.457s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['b6cfe54e-bccf-4996-9fe5-55e0614b26dd', '2ea3441f-12b0-4ed3-9811-5ffcb4f12d42', '6fe78605-cee8-4b57-a0bb-9ae4d8e91444', '6efd46f6-2525-458c-a511-18553a079845'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:35 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:35 devstack sudo[113901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:35 devstack sudo[113901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93605) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Flow 'volume_create_manager' (88195371-e9d8-4d0b-8372-7c6314935fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645af2b2-ef57-4a9f-9276-7a5a557b2d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645af2b2-ef57-4a9f-9276-7a5a557b2d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T12:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a653c805-ee2c-42e8-9ab0-a072553ddd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc01fd79b6a4242b8f66d007e625f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T12:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=57fabcb6-c940-461d-809e-e0cd88acfd04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T12:19:36Z,use_quota=True,user_id='383f45fef1ad46778502cd3b900cf990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94585d86-e8df-41b7-b03e-4866b5ca540e),volume_type_id=94585d86-e8df-41b7-b03e-4866b5ca540e)' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf110cd-3a47-4ca9-b1ce-064878dcd2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf110cd-3a47-4ca9-b1ce-064878dcd2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dc2e11-83c6-46f0-bc52-361ea2017471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dc2e11-83c6-46f0-bc52-361ea2017471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a653c805-ee2c-42e8-9ab0-a072553ddd93', 'volume_name': 'volume-a653c805-ee2c-42e8-9ab0-a072553ddd93', 'volume_size': 1, 'snapshot_id': '57fabcb6-c940-461d-809e-e0cd88acfd04'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850067a9-9241-4701-897f-4d034f78891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850067a9-9241-4701-897f-4d034f78891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2e463d-aae9-4b92-a2d3-97b6726523b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:36 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Volume a653c805-ee2c-42e8-9ab0-a072553ddd93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a653c805-ee2c-42e8-9ab0-a072553ddd93', 'volume_size': 1, 'snapshot_id': '57fabcb6-c940-461d-809e-e0cd88acfd04'} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-c3b67fd7-d368-4788-809a-d4c51a9b3b1a-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-quobyte-57fabcb6-c940-461d-809e-e0cd88acfd04-a653c805-ee2c-42e8-9ab0-a072553ddd93" by "_create_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-c3b67fd7-d368-4788-809a-d4c51a9b3b1a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-57fabcb6-c940-461d-809e-e0cd88acfd04-a653c805-ee2c-42e8-9ab0-a072553ddd93" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Creating volume a653c805-ee2c-42e8-9ab0-a072553ddd93 from snapshot 57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Selected osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412 as target Quobyte volume. {{(pid=93605) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-quobyte-a653c805-ee2c-42e8-9ab0-a072553ddd93" by "_copy_volume_from_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-a653c805-ee2c-42e8-9ab0-a072553ddd93" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] snapshot: 57fabcb6-c940-461d-809e-e0cd88acfd04, volume: a653c805-ee2c-42e8-9ab0-a072553ddd93, {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 14:19:36 devstack sudo[113901]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.711s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:36 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleted volume successfully. Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-c3b67fd7-d368-4788-809a-d4c51a9b3b1a" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-212c376c-70c6-4a6d-a0a5-09a2d9f9dec3 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-da378715-75c0-44d2-9d2a-711d27a00a6b-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91345d-1cfa-429f-b0cd-d50fde31a83a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-c3b67fd7-d368-4788-809a-d4c51a9b3b1a" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a32d37-d3d5-4c69-ad2c-071cb222cd4a]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:36 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:36 devstack sudo[113904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 Jun 23 14:19:36 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:36 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a Jun 23 14:19:36 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:37 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04" returned: 0 in 0.761s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b495d62c-36ab-4937-ae09-52300ccf3282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Creating direct copy from snapshot {{(pid=93605) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf359977-2f2a-407d-b588-7627a4a2c329]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:37 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:37 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:37 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a" returned: 0 in 0.850s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:37 devstack sudo[113916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a Jun 23 14:19:37 devstack sudo[113916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:37 devstack sudo[113916]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-c3b67fd7-d368-4788-809a-d4c51a9b3b1a" returned: 0 in 0.631s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-c3b67fd7-d368-4788-809a-d4c51a9b3b1a" released by "delete_volume" :: held 1.526s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:37 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 0.782s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG cinder.utils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Path /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 not found in is_blk_device check {{(pid=93605) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 14:19:37 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:38 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 Jun 23 14:19:38 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['c54a133f-be64-4f51-ae0a-f9e24eff4baa', '48f2bf1f-9bea-40fd-9f44-a47a51de3dee', '89a35acd-1505-4cd5-ae65-019f8afe28c2', '460a2ad0-aebb-4c6e-bbcb-a4385a574e0c'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:38 devstack sudo[113924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:38 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-6856af0b-d268-4f9e-8841-4dd21302c843-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-6856af0b-d268-4f9e-8841-4dd21302c843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-7596125c-968f-4735-a4ae-a4106fb39ee4" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-7596125c-968f-4735-a4ae-a4106fb39ee4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-6856af0b-d268-4f9e-8841-4dd21302c843" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-6856af0b-d268-4f9e-8841-4dd21302c843" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleting offline snapshot 6856af0b-d268-4f9e-8841-4dd21302c843 of volume 7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] snapshot_file for this snap is: volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ffa7b-58fe-410c-8cba-fd5fd7daedee]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:38 devstack sudo[113929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 Jun 23 14:19:38 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:38 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.673s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:38 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleted volume successfully. Jun 23 14:19:38 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-c55197b4-4983-4495-98ec-7bd1e0c67406 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-c3b67fd7-d368-4788-809a-d4c51a9b3b1a-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:40 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843" returned: 0 in 1.534s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:40 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7596125c-968f-4735-a4ae-a4106fb39ee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:19:40 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb230f6c-448b-4ea9-83fa-5c83fa9e5a24]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:40 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:40 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 Jun 23 14:19:40 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:42 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4" returned: 0 in 1.875s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:42 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:42 devstack sudo[113949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 Jun 23 14:19:42 devstack sudo[113949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:43 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93" returned: 0 in 5.072s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:43 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc16a0-56a2-43a5-89cf-ca649e716972]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:43 devstack sudo[113954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:43 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:43 devstack sudo[113949]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843" returned: 0 in 1.229s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:43 devstack sudo[113956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843 Jun 23 14:19:43 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:43 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:43 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4.6856af0b-d268-4f9e-8841-4dd21302c843" returned: 0 in 0.673s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-6856af0b-d268-4f9e-8841-4dd21302c843" released by "_delete_snapshot" :: held 5.499s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:44 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 0.978s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.image.image_utils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Image conversion details: src /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 {{(pid=93605) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 14:19:44 devstack cinder-volume[93605]: INFO cinder.image.image_utils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Converted 1024.00 MB image at 201.86 MB/s Jun 23 14:19:44 devstack cinder-volume[93605]: WARNING cinder.volume.drivers.remotefs [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 is being set with open permissions: ugo+rw Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-7596125c-968f-4735-a4ae-a4106fb39ee4" released by "delete_snapshot" :: held 5.552s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:44 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 Jun 23 14:19:44 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['869aeca0-2bdd-442f-ac48-cfa54f1070f2', 'a279b83c-fb2d-4c30-914b-1b48b9ace783', '44b93e45-2e38-46e5-8811-6af4bc99b094', 'd75d1437-75f8-4f7e-ae09-06c8054ac507'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Delete snapshot completed successfully. Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-35e64255-78ba-4e91-b8b1-55bef1d68a33 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-6856af0b-d268-4f9e-8841-4dd21302c843-delete_snapshot" released by "delete_snapshot" :: held 5.713s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:44 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93" returned: 0 in 0.676s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-a653c805-ee2c-42e8-9ab0-a072553ddd93" released by "_copy_volume_from_snapshot" :: held 8.385s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-57fabcb6-c940-461d-809e-e0cd88acfd04-a653c805-ee2c-42e8-9ab0-a072553ddd93" released by "_create_volume_from_snapshot" :: held 8.419s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.441s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2e463d-aae9-4b92-a2d3-97b6726523b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a653c805-ee2c-42e8-9ab0-a072553ddd93', 'volume_size': 1, 'snapshot_id': '57fabcb6-c940-461d-809e-e0cd88acfd04'}' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b333fe-3741-48ce-a189-2af9aa9e273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 14:19:44 devstack cinder-volume[93605]: INFO cinder.volume.flows.manager.create_volume [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Volume volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 (a653c805-ee2c-42e8-9ab0-a072553ddd93): created successfully Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b333fe-3741-48ce-a189-2af9aa9e273c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93605) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Flow 'volume_create_manager' (88195371-e9d8-4d0b-8372-7c6314935fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93605) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 14:19:44 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-75c3990c-96ba-45da-81ed-656b668bae96 tempest-SnapshotDependencyTests-1040258478 None] Created volume successfully. Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-7596125c-968f-4735-a4ae-a4106fb39ee4-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:44 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-7596125c-968f-4735-a4ae-a4106fb39ee4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "cinder-quobyte-7596125c-968f-4735-a4ae-a4106fb39ee4" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:45 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-7596125c-968f-4735-a4ae-a4106fb39ee4" acquired by "delete_volume" :: waited 0.014s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:45 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6735b8-113c-41da-b9c2-083b3b406180]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:45 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 Jun 23 14:19:45 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:45 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4" returned: 0 in 0.809s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:45 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:45 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4 Jun 23 14:19:45 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-57fabcb6-c940-461d-809e-e0cd88acfd04-delete_snapshot" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-57fabcb6-c940-461d-809e-e0cd88acfd04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-quobyte-b495d62c-36ab-4937-ae09-52300ccf3282" by "delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-b495d62c-36ab-4937-ae09-52300ccf3282" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-quobyte-57fabcb6-c940-461d-809e-e0cd88acfd04" by "_delete_snapshot" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-57fabcb6-c940-461d-809e-e0cd88acfd04" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Deleting offline snapshot 57fabcb6-c940-461d-809e-e0cd88acfd04 of volume b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] snapshot_file for this snap is: volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[098443dc-75c3-49d6-8d6a-6f150965556f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:46 devstack sudo[114012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 Jun 23 14:19:46 devstack sudo[114012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:46 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-7596125c-968f-4735-a4ae-a4106fb39ee4" returned: 0 in 0.767s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-quobyte-7596125c-968f-4735-a4ae-a4106fb39ee4" released by "delete_volume" :: held 1.634s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Created reservations ['d85de798-44af-470b-a616-f08d1a7b0733', 'a1ec5a9f-6202-4574-809c-6a33fdc66011', 'b25a1d9b-bdf8-4abe-a758-697455ba2eab', 'f95234b1-ad7b-4415-9a6d-6dca614dd726'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:46 devstack sudo[114012]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04" returned: 0 in 0.819s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.remotefs [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b495d62c-36ab-4937-ae09-52300ccf3282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93605) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deaa83b-9654-4dc2-ae98-63ddf9ff86ff]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:46 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:47 devstack sudo[114020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:47 devstack sudo[114020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:47 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:47 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:47 devstack sudo[114020]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.660s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:47 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:47 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Deleted volume successfully. Jun 23 14:19:47 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 0.805s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:47 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:47 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 Jun 23 14:19:47 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:47 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-0c8ec6b0-3364-4447-bb53-56e64739f065 tempest-CreateVolumesFromSnapshotTest-1865929171 None] Lock "cinder-7596125c-968f-4735-a4ae-a4106fb39ee4-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:48 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04" returned: 0 in 0.782s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:48 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:48 devstack sudo[114035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04 Jun 23 14:19:48 devstack sudo[114035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:49 devstack sudo[114035]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:49 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282.57fabcb6-c940-461d-809e-e0cd88acfd04" returned: 0 in 0.654s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-57fabcb6-c940-461d-809e-e0cd88acfd04" released by "_delete_snapshot" :: held 3.252s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:49 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-b495d62c-36ab-4937-ae09-52300ccf3282" released by "delete_snapshot" :: held 3.287s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:51 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:51 devstack sudo[114038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:51 devstack sudo[114038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Created reservations ['40a6a0b2-b6fe-4430-ae8f-215d9f766ea3', '25cce9f7-42bc-4a64-921f-23a1883c5bcd', '6e5eb527-a306-4ea3-b6d3-965cdfbb89ff', '6b241111-6fbe-4b25-803b-84a4542483ca'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:52 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Delete snapshot completed successfully. Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-01866d6b-9cbe-4ec0-8a50-927d822f38ca tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-57fabcb6-c940-461d-809e-e0cd88acfd04-delete_snapshot" released by "delete_snapshot" :: held 6.242s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:52 devstack sudo[114038]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.820s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG oslo_service.periodic_task [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] Running periodic task VolumeManager._thread_info {{(pid=93605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread count: 28 {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.volume.manager [None req-d7701e09-e1df-4927-bde3-132b1bd042c0 None None] thread info: [<_MainThread(MainThread, started 127938386702464)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-b495d62c-36ab-4937-ae09-52300ccf3282-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-b495d62c-36ab-4937-ae09-52300ccf3282-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-quobyte-b495d62c-36ab-4937-ae09-52300ccf3282" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-b495d62c-36ab-4937-ae09-52300ccf3282" acquired by "delete_volume" :: waited 0.017s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed2f3e4-3367-4788-97a8-4beaee3f555f]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:52 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:52 devstack sudo[114042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:52 devstack sudo[114042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:53 devstack sudo[114042]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 0.780s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:53 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:53 devstack sudo[114047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282 Jun 23 14:19:53 devstack sudo[114047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:54 devstack sudo[114047]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-b495d62c-36ab-4937-ae09-52300ccf3282" returned: 0 in 0.645s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-b495d62c-36ab-4937-ae09-52300ccf3282" released by "delete_volume" :: held 1.490s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Created reservations ['5642c6db-1d40-4f99-8556-48072b6320ec', '79d9aaee-6c75-4d9e-89ff-6045a45ffe8c', '399a0691-2884-490e-bc2a-c611d2b8156b', '38cb4056-bf2c-4621-8329-4c0d2e470707'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:54 devstack sudo[114051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:54 devstack sudo[114051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-a653c805-ee2c-42e8-9ab0-a072553ddd93-delete_volume" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-a653c805-ee2c-42e8-9ab0-a072553ddd93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "cinder-quobyte-a653c805-ee2c-42e8-9ab0-a072553ddd93" by "delete_volume" {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 14:19:54 devstack sudo[114051]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-a653c805-ee2c-42e8-9ab0-a072553ddd93" acquired by "delete_volume" :: waited 0.015s {{(pid=93605) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.658s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:54 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Deleted volume successfully. Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58fb0f-1846-4030-a956-0663ef897ce6]: (4, 'qcow2') {{(pid=94994) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:54 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-30ac1ec2-e19f-43bb-8ba8-c094957ac605 tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-b495d62c-36ab-4937-ae09-52300ccf3282-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:55 devstack sudo[114054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 Jun 23 14:19:55 devstack sudo[114054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:55 devstack sudo[114054]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93" returned: 0 in 0.748s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:55 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:55 devstack sudo[114059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93 Jun 23 14:19:55 devstack sudo[114059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:56 devstack sudo[114059]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec/volume-a653c805-ee2c-42e8-9ab0-a072553ddd93" returned: 0 in 0.659s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-quobyte-a653c805-ee2c-42e8-9ab0-a072553ddd93" released by "delete_volume" :: held 1.454s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG cinder.quota [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Created reservations ['97d6e08a-080a-4c9b-a9dd-098c24a8c588', '15779e6a-03ca-41c3-aa09-e6165c883960', '1ad203af-2c05-4716-acf8-3afd6a9b88e0', 'da669599-3f72-4f4c-9390-1e85fc985a1c'] {{(pid=93605) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412': None} {{(pid=93605) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG cinder.volume.drivers.quobyte [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9535e228-6b33-425e-9c3f-801f7da17412'] {{(pid=93605) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.lockutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93605) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 14:19:56 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 14:19:56 devstack sudo[114062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec Jun 23 14:19:56 devstack sudo[114062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 14:19:57 devstack sudo[114062]: pam_unix(sudo:session): session closed for user root Jun 23 14:19:57 devstack cinder-volume[93605]: DEBUG oslo_concurrency.processutils [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/bcfda4df5ed2ba6f667da27a7fbfc4ec" returned: 0 in 0.664s {{(pid=93605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 14:19:57 devstack cinder-volume[93605]: DEBUG cinder.manager [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Notifying Schedulers of capabilities ... {{(pid=93605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 14:19:57 devstack cinder-volume[93605]: INFO cinder.volume.manager [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Deleted volume successfully. Jun 23 14:19:57 devstack cinder-volume[93605]: DEBUG cinder.coordination [None req-65e94ce2-0380-4364-8848-d2438271eadc tempest-SnapshotDependencyTests-1040258478 None] Lock "cinder-a653c805-ee2c-42e8-9ab0-a072553ddd93-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=93605) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 14:20:06 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=131,cinder:SELECT=94,cinder:INSERT=36,cinder:DELETE=14 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:20:07 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=105,cinder:INSERT=38,cinder:UPDATE=137,cinder:DELETE=7 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:20:18 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:SELECT=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 14:20:18 devstack cinder-volume[93605]: DEBUG dbcounter [-] [93605] Writing DB stats cinder:UPDATE=1 {{(pid=93605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}